-- Logs begin at Tue 2022-06-07 12:27:57 UTC, end at Tue 2022-06-07 13:40:51 UTC. -- Jun 07 13:08:54.682402 dv-cinder-844601-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 13:08:54.691379 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 13:08:54 2022] *** Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: nodename: dv-cinder-844601-3-iscsi Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: machine: x86_64 Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: clock source: unix Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: pcre jit disabled Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: detected number of CPU cores: 4 Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: current working directory: / Jun 07 13:08:54.693361 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: detected binary path: /usr/bin/uwsgi-core Jun 07 13:08:54.694067 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: your processes number limit is 47680 Jun 07 13:08:54.694067 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: your memory page size is 4096 bytes Jun 07 13:08:54.694067 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: detected max file descriptor number: 2048 Jun 07 13:08:54.694067 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: lock engine: pthread robust mutexes Jun 07 13:08:54.694067 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: thunder lock: enabled Jun 07 13:08:54.694067 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 13:08:54.694067 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 13:08:54.738263 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: Python main interpreter initialized at 0x55b1b7e8c9c0 Jun 07 13:08:54.738263 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: python threads support enabled Jun 07 13:08:54.738263 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: your server socket listen backlog is limited to 100 connections Jun 07 13:08:54.738263 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: your mercy for graceful operations on workers is 90 seconds Jun 07 13:08:54.738577 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 13:08:54.738654 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: *** Operational MODE: preforking *** Jun 07 13:08:54.738932 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: *** uWSGI is running in multiple interpreter mode *** Jun 07 13:08:54.738932 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: spawned uWSGI master process (pid: 103387) Jun 07 13:08:54.739110 dv-cinder-844601-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 13:08:54.742929 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: spawned uWSGI worker 1 (pid: 103388, cores: 1) Jun 07 13:08:54.742929 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: spawned uWSGI worker 2 (pid: 103389, cores: 1) Jun 07 13:08:54.742929 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 13:08:55.961448 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:08:55.966085 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:08:56.693753 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:08:56.693753 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: from cryptography.utils import int_from_bytes Jun 07 13:08:56.693994 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:08:56.693994 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: from cryptography.utils import int_from_bytes Jun 07 13:08:56.715038 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:08:56.715038 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: from cryptography.utils import int_from_bytes Jun 07 13:08:56.715383 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:08:56.715383 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: from cryptography.utils import int_from_bytes Jun 07 13:08:59.246536 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:08:59.247117 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:08:59.247315 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:08:59.247674 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:08:59.247926 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:08:59.248310 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.248630 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.248945 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.249259 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.249585 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.249891 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.250206 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.250519 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.250857 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.251115 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.251224 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:08:59.251585 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.251671 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:08:59.251757 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-3-iscsi {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.251990 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:08:59.252093 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.252328 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.252413 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:08:59.252600 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:08:59.252695 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.252933 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.253027 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.253235 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.253343 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.253554 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.253666 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.253856 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.253953 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.254228 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.254350 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.254752 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.254921 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.255044 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.255152 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.255264 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.255399 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.255513 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.255761 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.255899 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.256073 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.256206 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.256377 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.256512 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-3-iscsi {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.256691 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.256828 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.256994 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.257128 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.257302 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.257433 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.257603 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.257730 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.257915 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.258048 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-3-iscsi {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.258240 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.258376 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.258548 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.258675 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.258923 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.259071 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.259334 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.259478 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.259641 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.259766 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.259945 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.260082 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.260263 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.260389 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.260582 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.260718 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.260885 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.261097 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.261225 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.261361 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.261486 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.261626 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.261810 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.261938 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.262118 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.262245 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.262412 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.262548 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-3-iscsi {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.262714 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.262858 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.263040 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.263180 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.263398 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.263545 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.263669 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.263848 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.264061 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.264205 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.264330 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.264453 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.264585 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.264749 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.264889 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.265065 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.265201 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.265373 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.265499 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.265637 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.265771 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.265903 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.266029 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.266152 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.266313 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.266455 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.266634 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.266773 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.266964 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.267103 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.267274 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.267414 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.267582 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.267717 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.267900 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.268027 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.268202 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.268338 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.268502 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.268637 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.268771 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.268894 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.269032 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.269157 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.269350 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.269478 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.269671 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.269806 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.269982 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.270118 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.270252 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.270385 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.270512 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.270671 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.270800 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.270953 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.271119 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.271742 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.271948 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.272085 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.272256 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.272398 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.272564 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.272692 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.272873 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.273013 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.273180 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.273315 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.273517 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.273644 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.273769 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.273901 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.274112 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.274247 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.274397 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.274524 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.274713 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.274862 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.275031 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.275174 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.275307 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.275432 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.275563 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.275688 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.275843 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.276049 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.276176 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.276304 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.276437 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.276599 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.276733 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.276938 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.277066 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.277258 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.277395 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.277569 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.277696 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.277866 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.277993 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.278165 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.278300 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.278464 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.278599 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.278763 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.278910 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.279087 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.279223 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.279386 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.279514 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.279685 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.279819 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.279983 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.280118 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.280242 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.280372 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.280543 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.280670 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.280850 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.280978 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.281163 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.281289 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.281460 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.281596 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.281759 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.281893 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.282065 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.282205 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.282362 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.282494 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.282661 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.282791 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.282992 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.283118 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.283299 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.283424 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.283635 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.283764 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.283888 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.284020 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.284171 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.284367 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.284495 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.284626 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.284758 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.284880 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.285050 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.285186 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.285349 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.285477 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.285660 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.285787 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.286004 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.286206 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.286342 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.286465 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.286589 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.286721 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.287442 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.287590 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.287743 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.287871 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.288045 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.288173 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.288343 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.288480 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.288643 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.288771 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.288935 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.289074 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.289249 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.289391 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.289565 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.289692 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.289868 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.289995 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.290168 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.290296 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.290466 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.290600 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.290773 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.290925 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.291119 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.291247 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.291441 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.291568 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.291755 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.291881 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.292063 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.292190 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.292369 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.292503 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.292674 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.292809 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.292978 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.293105 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.293284 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.293411 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.293600 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.293801 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.293936 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.294060 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.294185 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.294308 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.294506 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.294643 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.294768 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.294978 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.295094 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.295228 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.295407 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.295544 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.295712 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.295838 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.296026 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.296152 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:08:59.296337 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.296472 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.296647 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.296789 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.296951 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.297079 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.297262 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.297391 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.297584 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.297710 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.297899 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.298041 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.298191 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.298328 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.298523 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.298652 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.298880 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.299011 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.299190 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.299320 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.299510 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.299637 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.299824 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.299951 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.300132 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.300261 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.300438 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.300565 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.300743 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.300870 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.301060 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.301189 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.301375 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.301501 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.301684 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.301810 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.301998 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.302127 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.302304 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.302432 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.302637 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.302775 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.302953 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.303089 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.303258 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.303385 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.303566 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.303702 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.303906 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.304035 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.304195 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.304324 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.304550 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.304696 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.304822 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.304958 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.305114 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.305235 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.305421 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.305557 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.305725 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.305851 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.306029 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.306157 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.306327 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.306455 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.306625 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.306760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.306947 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.307088 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.307250 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.307379 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.307548 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.307682 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.307862 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.307989 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.308185 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.308314 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.308472 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.308609 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.308797 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.308925 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.309097 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.309226 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.309401 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.309539 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.309704 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.309840 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.310007 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.310134 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.310307 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.310435 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.310612 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.310748 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.310937 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.311078 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.311238 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.311366 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.311557 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.311694 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.311861 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.311989 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.312160 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.312288 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.312467 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.312602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.312766 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.312900 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.313063 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.313191 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.313373 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.313502 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.313675 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.313802 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.314002 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.314136 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.314268 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.314394 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.314569 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.314782 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.314928 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.315050 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.315211 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.315341 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.315515 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.315642 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.315826 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.315951 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.316136 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.316264 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.316441 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.316568 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.316765 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.316904 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.317078 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.317214 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.317391 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.317518 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.317716 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.317854 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.318039 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.318165 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.318346 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.318480 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.318644 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.318780 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.318969 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.319098 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.319274 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.319403 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.319572 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.319709 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.319871 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.319999 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.320171 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.320299 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.320469 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.320598 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.320765 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.320894 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.321082 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.321218 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.321386 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.321515 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.321683 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.321811 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.321983 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.322118 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.322282 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.322411 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.322618 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.322746 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.322941 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.323071 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.323259 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.323394 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.323566 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.323695 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.323871 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.324014 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.324220 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.324355 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.324480 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.324604 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.324831 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.324983 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.325111 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.325234 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.325358 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.325753 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.325921 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.326062 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.326227 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.326354 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.326539 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.326667 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.326879 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.327025 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.327174 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.327299 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.327477 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.327604 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.327779 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.327914 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.328085 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.328212 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.328397 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.328525 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.328695 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.328823 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.329000 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.329127 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.329330 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.329466 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.329660 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.329796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.329970 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.330098 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.330285 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.330414 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.330590 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.330719 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.330920 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.331049 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.331224 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.331353 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.331528 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.331657 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.331833 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.331960 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.332138 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.332275 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.332452 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.332579 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.332758 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.332886 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.333069 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.333207 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.333371 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.333500 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.334231 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.334368 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.334514 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.334647 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.334977 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.335114 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.335238 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.335363 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.335499 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.335635 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.335761 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.335884 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.336076 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.336210 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.336365 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.336494 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.336673 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.336802 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.336989 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.337123 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.337331 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.337466 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.337591 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.337715 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.337877 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.338005 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.338178 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.338307 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.338482 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.338611 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.338786 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.338962 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.339121 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.339251 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.339426 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.339561 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.339732 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.339861 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.340033 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.340161 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.340339 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.340465 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.340641 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.340782 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.340941 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.341068 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.341241 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.341377 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.341547 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.341683 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.341864 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.341992 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.342173 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.342301 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.342495 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.342629 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.342806 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.342983 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.343142 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.343269 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.343450 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.343590 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.343759 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.343887 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.344070 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.344203 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.344421 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.344549 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.344673 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.344805 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.344979 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.345181 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.345317 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.345443 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.345576 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.345701 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.345882 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.346011 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.346188 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.346317 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.346493 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.346621 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.346806 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.346949 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.347143 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.347291 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.347450 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.347578 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.347755 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.347892 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.348071 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.348200 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.348375 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.348500 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.348675 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.348814 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.348979 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.349106 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.349303 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.350041 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.350167 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.350305 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.350452 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.350580 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.350773 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.350956 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.351105 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.351244 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.351411 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.351547 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.351715 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.351843 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.352016 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.352144 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.352321 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.352449 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.352631 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.352759 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.353027 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.353192 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.353321 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.353521 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.353651 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.353833 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.353979 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.354149 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.354456 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.354592 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.354770 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.354949 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.355122 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.355438 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.355569 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.355784 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.355921 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.356087 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.356394 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.356532 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.356695 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.356879 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.357005 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.357291 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.357424 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.357593 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.357846 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.357973 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.358182 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.358332 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.358488 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.358788 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.358961 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.359111 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.359307 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.359434 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.359697 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.359826 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.360007 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.360270 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.360397 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.360600 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.360900 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.361173 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.361300 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.361509 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.361725 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.361853 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.362093 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.362221 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.362390 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.362674 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.362802 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.363048 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.363203 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.363385 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.363710 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.363839 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.364046 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.364223 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.364350 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.364636 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.364778 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.364980 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.365277 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.365567 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.365567 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.365812 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.365944 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.366156 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.366281 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.366458 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.366688 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.366815 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.367072 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.367213 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.367376 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.367665 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.367805 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.367971 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.368138 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.368265 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.368554 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.368688 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.368851 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.369077 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.369204 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.369452 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.369585 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.369750 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.370015 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.370142 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.370337 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.370485 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.370640 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.370957 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.371087 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.371263 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.371458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.371584 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.371859 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.371994 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.372159 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.372410 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.372537 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.372741 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.372877 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.373045 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.373348 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.373474 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.373646 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.373843 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.373978 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.374256 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.374390 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.374556 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.374778 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.374932 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.375174 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.375310 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.375539 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.375734 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.375863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.376063 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.376264 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.376393 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.376677 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.376812 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.376974 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.377249 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.377379 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.377562 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.377760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.377888 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.378150 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.378293 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.378452 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.378750 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.378892 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.379071 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.379258 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.379399 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.379653 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.379780 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.379951 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.380267 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.380403 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.380592 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.380846 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.380975 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.381181 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.381397 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.381533 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.381805 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.381933 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.382105 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.382460 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.382597 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.382762 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.383040 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.383169 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.383400 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.383593 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.383720 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.384135 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.384310 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.384610 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.384759 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.384957 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.385221 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.385358 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.385529 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.385798 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.385930 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.386117 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.386390 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.386518 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.386734 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.386900 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.387062 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.387205 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.387381 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.387518 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.387702 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.387831 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.388024 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.388163 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.388324 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.388453 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.388630 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.388759 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.388940 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.389082 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.389244 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.389374 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.389551 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.389680 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.389855 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.389986 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.390161 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.390289 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.390468 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.390597 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.390777 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.390937 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.391110 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.391240 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.391418 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.391550 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.391723 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.391862 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.392030 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.392160 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.392334 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.392466 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.392635 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.392766 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.392958 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.393084 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.393263 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.393399 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.393565 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.393693 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.393871 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.394005 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.394170 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.394308 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.394476 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.394605 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.394776 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.394977 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.395247 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.395504 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.395635 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.395862 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.395996 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.396666 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.396957 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.397174 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.397301 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.397530 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.397658 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.397857 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.397998 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.398163 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.398299 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.398476 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.398603 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.398788 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.398949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.399123 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.399252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.399434 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.399563 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.399742 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.399879 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.400057 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.400192 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.400364 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.400494 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.400670 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.400805 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.400972 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.401100 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.401273 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.401409 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.401571 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.401702 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.401892 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.402021 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.402195 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.402316 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.402513 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.402644 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.402890 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.403020 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.403215 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.403344 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.403532 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.403669 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.403848 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.403976 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.404163 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.404295 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.404471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.404600 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.404789 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.404917 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.405103 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.405316 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.405445 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.405577 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.405711 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.405838 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.406044 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.406182 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.406315 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.406441 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.406616 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.406752 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.406956 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.407102 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.407267 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.407403 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.407576 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.407705 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.407876 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.408014 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.408194 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.408324 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.408502 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.408629 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.408813 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.408942 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.409120 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.409245 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.409432 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.409561 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.409742 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.409870 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.410054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.410182 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.410367 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.410495 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.410680 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.410816 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.411019 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.411149 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.411336 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.411477 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.411640 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.411768 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.412513 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.412648 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.412838 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.412975 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.413148 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.413278 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.413477 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.413614 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.413798 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.413934 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.414107 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.414411 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.414540 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.414710 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.414999 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.415142 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.415350 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.415521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.415651 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.415953 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.416177 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.416307 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.416550 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.416764 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.416988 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.417268 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.417383 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.417609 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.417773 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.417901 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.418202 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.418316 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.418507 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.418749 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.418927 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.421206 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.421371 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.421507 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.421507 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.421760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.421902 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.422030 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.422155 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.422155 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.422391 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.422514 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.422651 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.422777 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.422777 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.423032 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.423157 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.423157 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.423408 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.423535 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.423535 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.423781 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.423913 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.424038 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.424175 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.424175 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.424427 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.424552 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.424552 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.424796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.424929 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.425062 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.425188 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.425188 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.425431 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.425626 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.425740 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.425845 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.425952 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.426217 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.426340 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.426569 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.426687 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.426875 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.427161 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.427274 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.427527 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.427706 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.427824 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.429762 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.430487 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.430636 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.430636 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.430904 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.431037 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.431163 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.431287 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.431287 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.431547 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.431672 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.431672 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.431906 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.432032 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.432032 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.432281 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.432406 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.432406 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.432658 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.432784 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.432923 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.433051 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.433051 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.433284 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.433406 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.433406 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.433668 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.433668 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.433912 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.433912 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.434147 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.434324 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.434452 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.434585 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.434710 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.434916 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.435059 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.435267 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.435434 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.435562 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.435869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.436000 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.436204 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.436433 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.436562 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.436780 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.436917 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.437098 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.437369 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.437499 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.437732 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.437883 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.438043 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.438355 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.438495 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.438666 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.438928 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.439076 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.439339 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.439567 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.439703 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.439937 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.440093 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.440246 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.440557 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.440692 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.440867 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.441090 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.441219 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.441469 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.441595 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.441801 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.442069 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.442210 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.442375 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.442567 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.442704 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.442999 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.443149 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.443336 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.443606 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.443736 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.443974 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.444103 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.444290 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.444592 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.444722 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.444900 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.445088 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.445216 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.445586 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.445715 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.446011 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.446141 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.446338 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.446544 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.446673 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.446931 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.447077 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.447255 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.447385 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.447588 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.447717 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.447911 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.448133 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.448275 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.448497 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.448651 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.448801 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.449102 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.449228 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.449401 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.449639 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.449768 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.450008 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.450136 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.450306 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.450894 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.451029 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.451201 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.451407 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.451728 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.451936 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.452073 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.452379 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.452514 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.452702 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.452830 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.453024 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.453154 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.453338 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.453601 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.453730 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.453950 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.454087 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.454254 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.454556 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.454691 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.454877 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.455120 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.455272 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.455473 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.455640 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.455767 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.456074 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.456219 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.456377 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.456634 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.456771 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.456968 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.457203 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.457340 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.457577 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.457711 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.457877 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.458013 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.458177 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.458393 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.458521 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.459307 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.459453 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.459609 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.459908 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.460044 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.460209 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.460397 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.460524 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.460802 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.460938 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.461100 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.461347 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.461475 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.461688 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.461827 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.461994 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.462307 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.462442 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.462593 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.462809 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.462949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.463275 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.463404 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.463575 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.463703 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.463873 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.464049 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.464191 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.464474 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.464609 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.464790 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.464990 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.465127 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.465390 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.465517 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.465729 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.465943 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.466154 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.466428 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.466558 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.466898 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.467034 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.467214 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.467464 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.467603 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.467858 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.467985 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.468163 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.468466 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.468600 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.468768 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.469010 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.469138 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.469378 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.469518 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.469684 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.469814 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.469988 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.470117 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.470292 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.470449 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.470587 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.470778 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.470936 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.471129 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.471266 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.471455 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.471597 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.471779 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.471907 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.472084 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.472212 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.472389 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.472519 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.472694 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.472823 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.472998 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.473135 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.473306 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.473436 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.473637 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.473764 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.473950 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.474078 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.474275 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.475076 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.475207 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.475415 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.475543 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.475726 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.475867 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.476033 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.476175 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.476375 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.476504 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.476707 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.476849 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.477037 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.477171 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.477296 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.477422 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.477568 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.477703 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.477836 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.477962 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.478160 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.478296 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.478493 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.478623 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.478822 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.478972 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.479162 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.479309 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.479470 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.479599 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.479789 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.479919 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.480108 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.480248 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.480418 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.480547 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.480733 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.480870 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.481037 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.481178 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.481363 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.481492 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.481694 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.481824 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.482010 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.482138 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.482329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.482457 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.482633 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.482769 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.482972 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.483101 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.483247 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.483384 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.483552 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.483690 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.483866 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.483995 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.484171 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.484301 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.484471 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.484608 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.484770 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.484900 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.485075 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.485204 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.485375 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.485514 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.485674 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.485810 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.485975 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.486104 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.486274 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.486494 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.486624 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.486756 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.486899 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.487051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.487249 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.487460 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.487589 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.487758 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.487888 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.488055 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.488201 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.488354 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.488484 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.488656 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.488786 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.488955 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.489092 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.489256 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.489393 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.489553 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.489712 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.489840 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.490062 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.490192 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.490375 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.490503 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.490692 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.490928 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.491057 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.491181 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.491328 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.491456 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.491654 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.491797 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.491970 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.492098 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.492276 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.492405 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.492601 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.492739 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.492915 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.493043 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.493224 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.493455 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.493597 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.493808 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.493937 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.494129 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.494266 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.494434 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.494574 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.494743 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.494893 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.495072 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.495213 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.495380 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.495522 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.495687 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.495815 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.496009 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.496137 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.496317 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.496446 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.496695 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.496832 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.496965 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.497092 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.497240 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.497430 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.497558 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.497681 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.497827 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.497955 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.498130 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.498259 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.498435 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.498562 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.498749 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.498910 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.499077 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.499208 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.499388 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.499524 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.499693 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.499842 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.499999 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.500125 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.500308 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.500443 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.500613 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.500750 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.500920 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.501046 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.501229 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.501356 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.501533 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.501669 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.501839 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.501965 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.502156 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.502285 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.502462 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.502603 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.502772 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.502930 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.503114 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.503250 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.503435 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.503574 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.503741 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.503870 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.504049 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.504183 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.504350 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.504481 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.504604 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:08:59.504730 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.505002 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.505309 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.505659 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.505974 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.506299 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.506614 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.506951 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.507300 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.507620 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.508155 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.508491 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.508814 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.509150 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.509485 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.509796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.510104 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.510409 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.510733 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.511071 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.511385 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.511696 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.512009 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.512318 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.512628 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.512939 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.513254 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.513563 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.513873 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.514185 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.514497 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.514807 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.515157 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.515499 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.515820 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.516138 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.516454 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.516771 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.517081 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.517392 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.517705 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.518014 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.518330 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.518663 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.519003 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.519312 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.519735 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.520050 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.520369 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.520692 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.521005 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.521856 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.522202 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.522501 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.522849 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.523160 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.523493 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.523840 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.524170 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.524498 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.524817 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.525111 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.525420 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.525730 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.526051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.526362 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.526668 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.527013 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.527306 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.527611 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.527921 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.528226 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.528532 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.528843 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.529147 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.529454 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.529760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.530067 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.530372 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.530676 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.531009 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.531317 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.531623 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.531927 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.532233 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.532536 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.532868 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.533203 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.533518 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.533847 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.534158 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.534482 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.534792 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.535140 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.535464 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.535784 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.536096 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.536427 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.536741 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.537696 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.538014 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.538326 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.538639 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.539002 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.539311 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.539642 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.539953 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.540282 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.540605 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.540930 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.541244 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.541559 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.541892 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.542205 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.542518 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.542845 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.543188 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.543504 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.543830 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.544149 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.544479 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.544809 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.545121 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.545450 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.545780 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.546131 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.546447 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.546794 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.547151 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.547468 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.547783 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.548094 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:08:59.548338 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:08:59.563072 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO dbcounter [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Registered counter for database nova_api Jun 07 13:08:59.583719 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_db.sqlalchemy.engines [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:08:59.590544 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writer thread running {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:08:59.607362 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO dbcounter [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Registered counter for database nova_api Jun 07 13:08:59.626911 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG oslo_db.sqlalchemy.engines [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:08:59.633776 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writer thread running {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:08:59.646979 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.context [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4(cell1) {{(pid=103388) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:08:59.651142 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:08:59.652688 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:08:59.653463 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:08:59.655434 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:08:59.657367 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO dbcounter [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Registered counter for database nova_cell0 Jun 07 13:08:59.661279 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO dbcounter [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Registered counter for database nova_cell1 Jun 07 13:08:59.668394 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_db.sqlalchemy.engines [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:08:59.670991 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_db.sqlalchemy.engines [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:08:59.674999 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writer thread running {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:08:59.690686 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.context [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4(cell1) {{(pid=103389) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:08:59.695398 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG oslo_concurrency.lockutils [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:08:59.696970 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG oslo_concurrency.lockutils [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:08:59.697757 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG oslo_concurrency.lockutils [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:08:59.699762 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG oslo_concurrency.lockutils [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:08:59.701997 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO dbcounter [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Registered counter for database nova_cell0 Jun 07 13:08:59.705950 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO dbcounter [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Registered counter for database nova_cell1 Jun 07 13:08:59.713716 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG oslo_db.sqlalchemy.engines [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:08:59.718585 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG oslo_db.sqlalchemy.engines [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:08:59.720398 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writer thread running {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:08:59.813147 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writer thread running {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:08:59.823574 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO dbcounter [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Registered counter for database nova_cell0 Jun 07 13:08:59.832494 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_db.sqlalchemy.engines [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:08:59.837418 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writer thread running {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:08:59.893583 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writer thread running {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:08:59.903098 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO dbcounter [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Registered counter for database nova_cell0 Jun 07 13:08:59.911951 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG oslo_db.sqlalchemy.engines [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:08:59.916137 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writer thread running {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:09:00.288161 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: WARNING keystonemiddleware.auth_token [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:09:00.295779 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: WARNING keystonemiddleware.auth_token [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:09:00.382458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: WARNING keystonemiddleware.auth_token [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:09:00.389786 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: WARNING keystonemiddleware.auth_token [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:09:00.518211 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: WARNING keystonemiddleware.auth_token [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:09:00.524582 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: WARNING keystonemiddleware.auth_token [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:09:00.529925 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b1b7e8c9c0 pid: 103388 (default app) Jun 07 13:09:00.533269 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:09:00.534454 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002841 Jun 07 13:09:00.534891 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Tue Jun 7 13:09:00 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:09:00.624193 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: WARNING keystonemiddleware.auth_token [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:09:00.630138 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: WARNING keystonemiddleware.auth_token [None req-ac7edfef-274f-409e-8397-a591680f3d6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:09:00.635473 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b1b7e8c9c0 pid: 103389 (default app) Jun 07 13:10:18.633884 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:18.635565 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Jun 07 13:10:18.636354 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:10:18.655510 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writing DB stats nova_api:SELECT=3 {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:18.656890 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writing DB stats nova_cell0:SELECT=3 {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:18.658030 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writing DB stats nova_cell1:SELECT=3 {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:18.658947 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writing DB stats nova_cell0:SELECT=3 {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:19.080609 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-60ede96f-caa9-44da-a158-e5a36ff189e0 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:19.112887 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-60ede96f-caa9-44da-a158-e5a36ff189e0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469673 Jun 07 13:10:19.119996 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Jun 7 13:10:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:10:21.418490 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:21.419669 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-db241736-68f2-4edc-87de-696f1c0575b1 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Jun 07 13:10:21.420373 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:10:21.484881 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-6e9f7949-9312-4f28-9faf-89223a8d66c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:21.503603 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:10:21.503603 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: warnings.warn(msg) Jun 07 13:10:21.544644 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-6e9f7949-9312-4f28-9faf-89223a8d66c1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.117846 Jun 07 13:10:21.545431 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:10:21.560873 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_api:SELECT=3 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:21.562033 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_cell1:SELECT=3 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:21.562764 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_cell0:SELECT=3 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:21.563526 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:10:21.775403 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-43b5881d-6aef-40c8-a3e5-a2be8962515e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:21.777824 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:10:21.777824 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: warnings.warn(msg) Jun 07 13:10:21.843460 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-43b5881d-6aef-40c8-a3e5-a2be8962515e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287903 Jun 07 13:10:21.844186 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Jun 7 13:10:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:10:24.146127 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-6e9f7949-9312-4f28-9faf-89223a8d66c1 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:24.147694 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-6e9f7949-9312-4f28-9faf-89223a8d66c1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Jun 07 13:10:24.148176 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:10:24.250670 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-2ce6b391-f41d-48cc-8892-f55f190427e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:24.268472 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:10:24.268472 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: warnings.warn(msg) Jun 07 13:10:24.286886 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-2ce6b391-f41d-48cc-8892-f55f190427e7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133087 Jun 07 13:10:24.288006 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:10:24.299796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-086e1475-0214-46b4-898c-753ddcac0ca2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:24.301408 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:10:24.301408 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: warnings.warn(msg) Jun 07 13:10:24.335668 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-086e1475-0214-46b4-898c-753ddcac0ca2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039624 Jun 07 13:10:24.336389 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Jun 7 13:10:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:10:26.632371 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-2ce6b391-f41d-48cc-8892-f55f190427e7 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:26.633961 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-2ce6b391-f41d-48cc-8892-f55f190427e7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Jun 07 13:10:26.639118 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:26 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:10:26.695726 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-af5b54db-4ab0-4e64-a01a-152d5b72212e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "swap": 0, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:26.715247 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-af5b54db-4ab0-4e64-a01a-152d5b72212e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074568 Jun 07 13:10:26.716423 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:10:26.728926 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-9fbfc019-47cd-485a-9e32-516a458a77af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:26.756227 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-9fbfc019-47cd-485a-9e32-516a458a77af admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031801 Jun 07 13:10:26.756822 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Jun 7 13:10:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:10:29.060297 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-af5b54db-4ab0-4e64-a01a-152d5b72212e admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:29.061406 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-af5b54db-4ab0-4e64-a01a-152d5b72212e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Jun 07 13:10:29.061808 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:10:29.124488 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-3f906217-fd8c-47f8-b6ca-728ca13b38a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "ram": 2048}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:29.143006 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-3f906217-fd8c-47f8-b6ca-728ca13b38a2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074858 Jun 07 13:10:29.143579 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:10:29.155473 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-9b518770-64bd-4434-a98d-cfa7289ef671 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:29.180336 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-9b518770-64bd-4434-a98d-cfa7289ef671 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028554 Jun 07 13:10:29.180945 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Jun 7 13:10:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:10:31.472951 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-3f906217-fd8c-47f8-b6ca-728ca13b38a2 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:31.473977 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-3f906217-fd8c-47f8-b6ca-728ca13b38a2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 07 13:10:31.474394 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:10:31.533709 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-bf0882a6-50b5-4219-8ff8-6f7dc6563cdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G"}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:31.551862 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-bf0882a6-50b5-4219-8ff8-6f7dc6563cdb admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071544 Jun 07 13:10:31.552418 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:10:31.564653 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-e27f9ef3-0a66-41da-bd50-aab215e14865 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:31.589260 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-e27f9ef3-0a66-41da-bd50-aab215e14865 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028202 Jun 07 13:10:31.589843 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Jun 7 13:10:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:10:33.885980 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-bf0882a6-50b5-4219-8ff8-6f7dc6563cdb admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:33.887114 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-bf0882a6-50b5-4219-8ff8-6f7dc6563cdb admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 07 13:10:33.887521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:10:33.951281 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-4bd36be5-74a3-4bdc-a088-68b17cb31138 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:33.974757 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-4bd36be5-74a3-4bdc-a088-68b17cb31138 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081096 Jun 07 13:10:33.975442 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Jun 7 13:10:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:10:36.528369 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-bf0882a6-50b5-4219-8ff8-6f7dc6563cdb admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:36.529395 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-bf0882a6-50b5-4219-8ff8-6f7dc6563cdb admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 07 13:10:36.529818 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:10:36.589571 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-857f86d6-4ef4-410e-bc90-46d6140fc77d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:36.606987 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-857f86d6-4ef4-410e-bc90-46d6140fc77d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070234 Jun 07 13:10:36.607567 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:10:36.621761 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-2eeb71e2-3ce6-40af-ba1b-49ffaa1d5af9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:36.646459 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-2eeb71e2-3ce6-40af-ba1b-49ffaa1d5af9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028175 Jun 07 13:10:36.647256 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Jun 7 13:10:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:10:39.474137 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-857f86d6-4ef4-410e-bc90-46d6140fc77d admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:39.475772 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-857f86d6-4ef4-410e-bc90-46d6140fc77d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Jun 07 13:10:39.476244 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:10:39.544011 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-99714912-6ec8-48bb-844b-94402a4d4155 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "disk": 20}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:39.566623 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-99714912-6ec8-48bb-844b-94402a4d4155 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084371 Jun 07 13:10:39.567419 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:10:39.582961 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-f858dd90-fa19-44e2-a0a0-4a7948a01090 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:39.604896 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-f858dd90-fa19-44e2-a0a0-4a7948a01090 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025896 Jun 07 13:10:39.605683 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Jun 7 13:10:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:10:41.895201 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-99714912-6ec8-48bb-844b-94402a4d4155 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:41.896210 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-99714912-6ec8-48bb-844b-94402a4d4155 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jun 07 13:10:41.897196 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:10:41.954724 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-542c479c-7165-485d-8ee5-3268c1bd2ed3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "id": "3"}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:41.975341 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-542c479c-7165-485d-8ee5-3268c1bd2ed3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072432 Jun 07 13:10:41.975895 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:10:41.987722 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-205aaf76-394a-48b9-8524-6818f659ac85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:42.011117 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-205aaf76-394a-48b9-8524-6818f659ac85 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027069 Jun 07 13:10:42.011865 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Jun 7 13:10:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:10:44.275522 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-542c479c-7165-485d-8ee5-3268c1bd2ed3 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:44.276709 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-542c479c-7165-485d-8ee5-3268c1bd2ed3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001681 Jun 07 13:10:44.277178 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:10:44.350198 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-3610da1c-1581-4358-a364-7e5460b18df2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:44.370989 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-3610da1c-1581-4358-a364-7e5460b18df2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087675 Jun 07 13:10:44.371644 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:10:44.383801 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-b4c64080-7cf2-4d39-9615-5568b2f5797f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:44.407318 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-b4c64080-7cf2-4d39-9615-5568b2f5797f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027742 Jun 07 13:10:44.408026 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Jun 7 13:10:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:10:46.735831 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-3610da1c-1581-4358-a364-7e5460b18df2 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:10:46.737714 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-3610da1c-1581-4358-a364-7e5460b18df2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002350 Jun 07 13:10:46.738433 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:10:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:10:46.811671 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-183d1f56-4eca-4a93-a01d-2dc9f6e52794 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160, "id": "5", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:46.831087 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-183d1f56-4eca-4a93-a01d-2dc9f6e52794 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081079 Jun 07 13:10:46.831646 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Jun 7 13:10:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:10:46.845745 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-afbf2c74-ee18-4893-87b9-c8de1ca911ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:10:46.869730 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-afbf2c74-ee18-4893-87b9-c8de1ca911ab admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027678 Jun 07 13:10:46.870310 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Jun 7 13:10:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:11:10.517003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-183d1f56-4eca-4a93-a01d-2dc9f6e52794 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:10.518013 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-183d1f56-4eca-4a93-a01d-2dc9f6e52794 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 07 13:11:10.518413 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:11:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:10.528988 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:10.576816 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-c3e9b3f3-4604-44e6-85eb-506024edf890 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:10.594591 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-c3e9b3f3-4604-44e6-85eb-506024edf890 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070274 Jun 07 13:11:10.595146 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Jun 7 13:11:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:11:11.583425 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-183d1f56-4eca-4a93-a01d-2dc9f6e52794 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:11.584432 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-183d1f56-4eca-4a93-a01d-2dc9f6e52794 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 07 13:11:11.584826 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:11.778948 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-8d48a792-bae1-42e4-b8f7-62f752d08bb9 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:11.784442 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.wsgi [None req-8d48a792-bae1-42e4-b8f7-62f752d08bb9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-8d48a792-bae1-42e4-b8f7-62f752d08bb9 admin admin] Request method failure captured: Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Accept: application/json Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Accept-Encoding: gzip, deflate Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Connection: keep-alive Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Content-Length: 0 Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Host: 10.222.0.61 Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Openstack-Api-Version: compute 2.90 Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Openstack-System-Scope: None Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: User-Agent: python-novaclient Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Auth-Token: gAAAAABin05vCVUJnS_0ZkYV92gaM_aI6DhF1nZzYNhfhiraORlAk6GxBHiJFE8kEaAxGIRvXHvKv6qdl_lxPmqd-Isq4jfmAYRHYj41VAVnlyyovGCDpTibEs9G_uGn5_gHOxYIvvCCSvRZx7cWZP05ONIxn0mEc-4JlpeLfC8_z4O4h6wSdU0 Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Domain-Id: None Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Domain-Name: None Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Identity-Status: Confirmed Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Is-Admin-Project: True Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Domain-Id: default Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Domain-Name: Default Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Name: admin Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Role: admin,member,reader Jun 07 13:11:11.787647 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Roles: admin,member,reader Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f9260a652cb24f75867436268df3aa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Tenant: admin Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Tenant-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Tenant-Name: admin Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User: admin Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Domain-Id: default Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Domain-Name: Default Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Id: 05d0278bf67f4654af88f4f7c25092c2 Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Name: admin Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: method: > Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: exception: Flavor 42 could not be found. Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: action_args: {'id': '42'} Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:11:11.789869 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:11.790760 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.792054 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-8d48a792-bae1-42e4-b8f7-62f752d08bb9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:11:11.793159 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-8d48a792-bae1-42e4-b8f7-62f752d08bb9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060535 Jun 07 13:11:11.793159 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Jun 7 13:11:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:11.799442 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-33d1ea5c-bd6a-4c72-b743-32069997f623 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:11.802409 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:11.823389 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-33d1ea5c-bd6a-4c72-b743-32069997f623 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027492 Jun 07 13:11:11.823931 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Jun 7 13:11:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:11:11.833689 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-d3f6c29c-aeb1-40f7-a544-60e102ec1f52 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:11.855683 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-d3f6c29c-aeb1-40f7-a544-60e102ec1f52 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025828 Jun 07 13:11:11.856212 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Jun 7 13:11:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:11:11.865858 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-5d1d06ce-d210-40bf-88be-5706962f2376 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:11.871786 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.wsgi [None req-5d1d06ce-d210-40bf-88be-5706962f2376 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-5d1d06ce-d210-40bf-88be-5706962f2376 admin admin] Request method failure captured: Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Accept: application/json Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Accept-Encoding: gzip, deflate Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Connection: keep-alive Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Content-Length: 0 Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Host: 10.222.0.61 Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Openstack-Api-Version: compute 2.90 Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Openstack-System-Scope: None Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: User-Agent: python-novaclient Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Auth-Token: gAAAAABin05vCVUJnS_0ZkYV92gaM_aI6DhF1nZzYNhfhiraORlAk6GxBHiJFE8kEaAxGIRvXHvKv6qdl_lxPmqd-Isq4jfmAYRHYj41VAVnlyyovGCDpTibEs9G_uGn5_gHOxYIvvCCSvRZx7cWZP05ONIxn0mEc-4JlpeLfC8_z4O4h6wSdU0 Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Domain-Id: None Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Domain-Name: None Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Identity-Status: Confirmed Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Is-Admin-Project: True Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Domain-Id: default Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Domain-Name: Default Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Name: admin Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Role: admin,member,reader Jun 07 13:11:11.875003 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Roles: admin,member,reader Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f9260a652cb24f75867436268df3aa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Tenant: admin Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Tenant-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Tenant-Name: admin Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User: admin Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Domain-Id: default Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Domain-Name: Default Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Id: 05d0278bf67f4654af88f4f7c25092c2 Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Name: admin Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: method: > Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: exception: Flavor 42 could not be found. Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: action_args: {'id': '42'} Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:11:11.876479 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:11.877427 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:11.878949 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-5d1d06ce-d210-40bf-88be-5706962f2376 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:11:11.880149 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-5d1d06ce-d210-40bf-88be-5706962f2376 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014543 Jun 07 13:11:11.880149 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Jun 7 13:11:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:12.734240 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-d3f6c29c-aeb1-40f7-a544-60e102ec1f52 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:12.735309 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-d3f6c29c-aeb1-40f7-a544-60e102ec1f52 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 07 13:11:12.735708 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:12.922915 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-26910a0d-69ff-4b2a-a3c4-f2bf21e7abb9 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:12.928215 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.wsgi [None req-26910a0d-69ff-4b2a-a3c4-f2bf21e7abb9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-26910a0d-69ff-4b2a-a3c4-f2bf21e7abb9 admin admin] Request method failure captured: Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Accept: application/json Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Accept-Encoding: gzip, deflate Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Connection: keep-alive Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Content-Length: 0 Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Host: 10.222.0.61 Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Openstack-Api-Version: compute 2.90 Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Openstack-System-Scope: None Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: User-Agent: python-novaclient Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Auth-Token: gAAAAABin05w7j4y8RQUtXxSfkmdhE5cZ6n-yMdBHfK1Vy3bwkafjLOsqwC0etw9bfzb4stnxWlVWEfltLUMdOxUoEmP7S8awx1QvQJ1JeOeh6bjWkYEkkZL5VQtH1UW3xH8jBmWsmzch-vuhkBRcVX1eaCwAtSNK-aHXs0sy5W_0pPc5xzJ2-U Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Domain-Id: None Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Domain-Name: None Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Identity-Status: Confirmed Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Is-Admin-Project: True Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Domain-Id: default Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Domain-Name: Default Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Name: admin Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Role: admin,member,reader Jun 07 13:11:12.930329 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Roles: admin,member,reader Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f9260a652cb24f75867436268df3aa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Tenant: admin Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Tenant-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Tenant-Name: admin Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User: admin Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Domain-Id: default Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Domain-Name: Default Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Id: 05d0278bf67f4654af88f4f7c25092c2 Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Name: admin Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: method: > Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: exception: Flavor 84 could not be found. Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: action_args: {'id': '84'} Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:11:12.931863 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:12.932799 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.933869 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-26910a0d-69ff-4b2a-a3c4-f2bf21e7abb9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:11:12.934953 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-26910a0d-69ff-4b2a-a3c4-f2bf21e7abb9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060529 Jun 07 13:11:12.934953 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Jun 7 13:11:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:12.941570 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-ad47b971-2dcf-49b6-9e12-4678fb4ddc78 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:12.955006 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-ad47b971-2dcf-49b6-9e12-4678fb4ddc78 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016935 Jun 07 13:11:12.955727 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Jun 7 13:11:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:11:12.964661 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-3f91c986-5bb3-4484-a7fd-a9ba736fee8f admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:12.978631 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-3f91c986-5bb3-4484-a7fd-a9ba736fee8f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017397 Jun 07 13:11:12.979176 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Jun 7 13:11:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:11:12.987807 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-3fc73277-2e52-44bb-a07a-a309e41d155a admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:12.993526 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.wsgi [None req-3fc73277-2e52-44bb-a07a-a309e41d155a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-3fc73277-2e52-44bb-a07a-a309e41d155a admin admin] Request method failure captured: Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Accept: application/json Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Accept-Encoding: gzip, deflate Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Connection: keep-alive Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Content-Length: 0 Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Host: 10.222.0.61 Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Openstack-Api-Version: compute 2.90 Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Openstack-System-Scope: None Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: User-Agent: python-novaclient Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Auth-Token: gAAAAABin05w7j4y8RQUtXxSfkmdhE5cZ6n-yMdBHfK1Vy3bwkafjLOsqwC0etw9bfzb4stnxWlVWEfltLUMdOxUoEmP7S8awx1QvQJ1JeOeh6bjWkYEkkZL5VQtH1UW3xH8jBmWsmzch-vuhkBRcVX1eaCwAtSNK-aHXs0sy5W_0pPc5xzJ2-U Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Domain-Id: None Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Domain-Name: None Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Identity-Status: Confirmed Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Is-Admin-Project: True Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Domain-Id: default Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Domain-Name: Default Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Name: admin Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Role: admin,member,reader Jun 07 13:11:12.995051 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Roles: admin,member,reader Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f9260a652cb24f75867436268df3aa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Tenant: admin Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Tenant-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Tenant-Name: admin Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User: admin Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Domain-Id: default Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Domain-Name: Default Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Id: 05d0278bf67f4654af88f4f7c25092c2 Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Name: admin Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: method: > Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: exception: Flavor 84 could not be found. Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: action_args: {'id': '84'} Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:11:12.996521 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:12.997458 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:12.998796 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-3fc73277-2e52-44bb-a07a-a309e41d155a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:11:13.000122 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-3fc73277-2e52-44bb-a07a-a309e41d155a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011921 Jun 07 13:11:13.000122 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Jun 7 13:11:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 07 13:11:13.853405 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-3f91c986-5bb3-4484-a7fd-a9ba736fee8f admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:13.854413 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-3f91c986-5bb3-4484-a7fd-a9ba736fee8f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 07 13:11:13.854805 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:11:14.039825 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-bd7b94ff-89b4-448a-8ca3-10a3bde7a623 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:14.045530 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.wsgi [None req-bd7b94ff-89b4-448a-8ca3-10a3bde7a623 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-bd7b94ff-89b4-448a-8ca3-10a3bde7a623 admin admin] Request method failure captured: Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Accept: application/json Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Accept-Encoding: gzip, deflate Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Connection: keep-alive Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Content-Length: 0 Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Host: 10.222.0.61 Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Openstack-Api-Version: compute 2.90 Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Openstack-System-Scope: None Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: User-Agent: python-novaclient Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Auth-Token: gAAAAABin05xQzfcMX_-rHpe-axf0x_eGAMpuVH0caQhLa02jtoqQOr2X2nF7sacRXGd4Cay6WmJxPdRnjWHQfCWaNTkS76ZadPsD8cnpYNmM53q0W8oOvVnuxId3Kd__lA8VeK3WCqHQwC4SbfPzgpBWCs1r6KurMmbbaFRKoomYpBZDXIcLBM Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Domain-Id: None Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Domain-Name: None Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Identity-Status: Confirmed Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Is-Admin-Project: True Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Domain-Id: default Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Domain-Name: Default Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Project-Name: admin Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Role: admin,member,reader Jun 07 13:11:14.047058 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Roles: admin,member,reader Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f9260a652cb24f75867436268df3aa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Tenant: admin Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Tenant-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-Tenant-Name: admin Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User: admin Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Domain-Id: default Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Domain-Name: Default Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Id: 05d0278bf67f4654af88f4f7c25092c2 Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: X-User-Name: admin Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: method: > Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: exception: Flavor 451 could not be found. Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: action_args: {'id': '451'} Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:11:14.048527 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:14.049471 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.050747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-bd7b94ff-89b4-448a-8ca3-10a3bde7a623 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:11:14.052045 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-bd7b94ff-89b4-448a-8ca3-10a3bde7a623 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058935 Jun 07 13:11:14.052045 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Jun 7 13:11:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:14.058811 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-76d2ac81-8db7-4ee7-ade8-2477213270f0 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:14.073149 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-76d2ac81-8db7-4ee7-ade8-2477213270f0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017866 Jun 07 13:11:14.073619 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Jun 7 13:11:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:11:14.082865 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:14.096235 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017106 Jun 07 13:11:14.096747 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Jun 7 13:11:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:11:14.105584 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-6a987d6e-cd38-47d1-84cf-1a2e7a70095d admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:14.110691 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.wsgi [None req-6a987d6e-cd38-47d1-84cf-1a2e7a70095d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-6a987d6e-cd38-47d1-84cf-1a2e7a70095d admin admin] Request method failure captured: Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Accept: application/json Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Accept-Encoding: gzip, deflate Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Connection: keep-alive Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Content-Length: 0 Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Host: 10.222.0.61 Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Openstack-Api-Version: compute 2.90 Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Openstack-System-Scope: None Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: User-Agent: python-novaclient Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Auth-Token: gAAAAABin05xQzfcMX_-rHpe-axf0x_eGAMpuVH0caQhLa02jtoqQOr2X2nF7sacRXGd4Cay6WmJxPdRnjWHQfCWaNTkS76ZadPsD8cnpYNmM53q0W8oOvVnuxId3Kd__lA8VeK3WCqHQwC4SbfPzgpBWCs1r6KurMmbbaFRKoomYpBZDXIcLBM Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Domain-Id: None Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Domain-Name: None Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Identity-Status: Confirmed Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Is-Admin-Project: True Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Domain-Id: default Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Domain-Name: Default Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Project-Name: admin Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Role: admin,member,reader Jun 07 13:11:14.112252 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Roles: admin,member,reader Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f9260a652cb24f75867436268df3aa69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f9260a652cb24f75867436268df3aa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f9260a652cb24f75867436268df3aa69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Tenant: admin Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Tenant-Id: f9260a652cb24f75867436268df3aa69 Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-Tenant-Name: admin Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User: admin Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Domain-Id: default Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Domain-Name: Default Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Id: 05d0278bf67f4654af88f4f7c25092c2 Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: X-User-Name: admin Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: method: > Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: exception: Flavor 451 could not be found. Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: action_args: {'id': '451'} Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:11:14.113751 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:14.114602 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: ERROR nova.api.openstack.wsgi Jun 07 13:11:14.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-6a987d6e-cd38-47d1-84cf-1a2e7a70095d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:11:14.117771 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-6a987d6e-cd38-47d1-84cf-1a2e7a70095d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011514 Jun 07 13:11:14.117771 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Jun 7 13:11:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:11:14.970433 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:14.971490 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 07 13:11:14.971902 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:15.159200 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-636e32d2-a34e-4f2f-aa47-12eb8eab7042 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:11:15.177104 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-636e32d2-a34e-4f2f-aa47-12eb8eab7042 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068782 Jun 07 13:11:15.177640 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Jun 7 13:11:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:11:16.042603 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:16.043654 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 07 13:11:16.044056 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:16.236935 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-5c890056-17b0-4808-b5ee-d2674a80812b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:11:16.254062 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-5c890056-17b0-4808-b5ee-d2674a80812b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068502 Jun 07 13:11:16.254537 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Jun 7 13:11:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:11:17.114069 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:17.115129 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 07 13:11:17.115539 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:17.303266 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-9db00db0-b1f6-4c4d-a0be-53c687ab3dd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:11:17.320455 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-9db00db0-b1f6-4c4d-a0be-53c687ab3dd8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068046 Jun 07 13:11:17.320991 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Jun 7 13:11:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:11:18.182331 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:18.183387 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jun 07 13:11:18.183807 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:18.371670 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-46593215-ea84-4889-bb91-8385045b7910 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:11:18.388942 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-46593215-ea84-4889-bb91-8385045b7910 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068677 Jun 07 13:11:18.389408 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Jun 7 13:11:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:11:19.276850 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:19.277888 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 07 13:11:19.278282 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:11:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:19.467980 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-e4aae608-e2ed-41d6-ada4-ee9965de14fa admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:19.487212 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-e4aae608-e2ed-41d6-ada4-ee9965de14fa admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074270 Jun 07 13:11:19.487746 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Tue Jun 7 13:11:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:20.254738 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:20.255825 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-b3087cf8-9dab-4195-9266-9f5dfb43fcc2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jun 07 13:12:20.256233 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Tue Jun 7 13:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:12:20.263695 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:20.315371 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-783103ab-dc5b-4121-8d4f-02e8618f6e08 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:20.339532 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-783103ab-dc5b-4121-8d4f-02e8618f6e08 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076965 Jun 07 13:12:20.340492 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Jun 7 13:12:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:20.363862 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG dbcounter [-] [103389] Writing DB stats nova_api:SELECT=14 {{(pid=103389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:20.367769 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-b18e226d-39a0-4cbd-99e8-4a09079df154 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:20.375503 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-b18e226d-39a0-4cbd-99e8-4a09079df154 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013128 Jun 07 13:12:20.376041 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Tue Jun 7 13:12:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:20.388217 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-22c538a3-5229-4f21-8f42-7599b4a8c689 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:20.396212 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-22c538a3-5229-4f21-8f42-7599b4a8c689 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011925 Jun 07 13:12:20.396773 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Tue Jun 7 13:12:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:20.408668 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:20.417106 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012062 Jun 07 13:12:20.417634 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Tue Jun 7 13:12:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:20.430379 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-3d4c5cdd-945a-4ff5-81c3-fb33b2a9c228 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:20.439480 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-3d4c5cdd-945a-4ff5-81c3-fb33b2a9c228 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013778 Jun 07 13:12:20.440351 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Tue Jun 7 13:12:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:56.963125 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:56.964345 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001715 Jun 07 13:15:56.964842 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:15:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:57.120272 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_api:SELECT=6 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:57.232028 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-c6dd4b31-d52e-4ffd-be6d-d3a473571204 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:57.233186 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:15:57.233186 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: warnings.warn(msg) Jun 07 13:15:57.234365 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-c6dd4b31-d52e-4ffd-be6d-d3a473571204 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:57.234804 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-c6dd4b31-d52e-4ffd-be6d-d3a473571204 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:57.235595 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-c6dd4b31-d52e-4ffd-be6d-d3a473571204 admin admin] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:57.236019 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-c6dd4b31-d52e-4ffd-be6d-d3a473571204 admin admin] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:57.268845 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-c6dd4b31-d52e-4ffd-be6d-d3a473571204 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150109 Jun 07 13:15:57.269387 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Jun 7 13:15:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:15:58.134024 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:58.135063 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 07 13:15:58.135463 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:15:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:58.331995 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-a70d1c9e-d7b6-4194-867d-a62db76e1ff5 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:58.333194 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:15:58.333194 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: warnings.warn(msg) Jun 07 13:15:58.334382 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-a70d1c9e-d7b6-4194-867d-a62db76e1ff5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:58.334820 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-a70d1c9e-d7b6-4194-867d-a62db76e1ff5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:58.335623 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-a70d1c9e-d7b6-4194-867d-a62db76e1ff5 admin admin] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:58.336095 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-a70d1c9e-d7b6-4194-867d-a62db76e1ff5 admin admin] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:58.357768 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-a70d1c9e-d7b6-4194-867d-a62db76e1ff5 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077857 Jun 07 13:15:58.358268 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Jun 7 13:15:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:16:09.632829 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:09.633850 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 07 13:16:09.634255 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:16:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:09.774665 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_cell0:SELECT=4 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:09.775415 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_cell1:SELECT=4 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:09.776081 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG dbcounter [-] [103388] Writing DB stats nova_api:SELECT=8 {{(pid=103388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:09.823850 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-85ca5fb8-16e1-4c10-b6ce-9a5184d6494e admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:09.824996 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:16:09.824996 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: warnings.warn(msg) Jun 07 13:16:09.826680 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-85ca5fb8-16e1-4c10-b6ce-9a5184d6494e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.827214 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-85ca5fb8-16e1-4c10-b6ce-9a5184d6494e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.827990 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-85ca5fb8-16e1-4c10-b6ce-9a5184d6494e admin admin] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.828416 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-85ca5fb8-16e1-4c10-b6ce-9a5184d6494e admin admin] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.853393 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-85ca5fb8-16e1-4c10-b6ce-9a5184d6494e admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083216 Jun 07 13:16:09.853934 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Jun 7 13:16:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:10.729537 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: DEBUG nova.api.openstack.wsgi [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] Calling method '>' {{(pid=103389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:10.730555 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: INFO nova.api.openstack.requestlog [None req-405d1137-4ac0-4b46-9d06-b6a84dd6c2e7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 07 13:16:10.730993 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: [pid: 103389|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Jun 7 13:16:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:10.923368 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG nova.api.openstack.wsgi [None req-38656009-accd-48d7-a877-90e0a9e99f72 admin admin] Calling method '>' {{(pid=103388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:10.924545 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:16:10.924545 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: warnings.warn(msg) Jun 07 13:16:10.925715 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-38656009-accd-48d7-a877-90e0a9e99f72 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:10.926145 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-38656009-accd-48d7-a877-90e0a9e99f72 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:10.926998 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-38656009-accd-48d7-a877-90e0a9e99f72 admin admin] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:10.927422 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: DEBUG oslo_concurrency.lockutils [None req-38656009-accd-48d7-a877-90e0a9e99f72 admin admin] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:10.949495 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: INFO nova.api.openstack.requestlog [None req-38656009-accd-48d7-a877-90e0a9e99f72 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081119 Jun 07 13:16:10.949967 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: [pid: 103388|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Jun 7 13:16:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:10.108206 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: Tue Jun 7 13:17:10 2022 - graceful shutdown triggered... Jun 07 13:17:10.108727 dv-cinder-844601-3-iscsi devstack@n-api.service[103389]: Gracefully killing worker 2 (pid: 103389)... Jun 07 13:17:10.108325 dv-cinder-844601-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 13:17:10.109566 dv-cinder-844601-3-iscsi devstack@n-api.service[103388]: Gracefully killing worker 1 (pid: 103388)... Jun 07 13:17:11.109335 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: worker 1 buried after 1 seconds Jun 07 13:17:11.109335 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: worker 2 buried after 1 seconds Jun 07 13:17:11.109335 dv-cinder-844601-3-iscsi devstack@n-api.service[103387]: goodbye to uWSGI. Jun 07 13:17:11.110795 dv-cinder-844601-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 13:17:11.111387 dv-cinder-844601-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 13:17:11.114586 dv-cinder-844601-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 13:17:11.131275 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 13:17:11 2022] *** Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: nodename: dv-cinder-844601-3-iscsi Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: machine: x86_64 Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: clock source: unix Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: pcre jit disabled Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: detected number of CPU cores: 4 Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: current working directory: / Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: detected binary path: /usr/bin/uwsgi-core Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: your processes number limit is 47680 Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: your memory page size is 4096 bytes Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: detected max file descriptor number: 2048 Jun 07 13:17:11.150979 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: lock engine: pthread robust mutexes Jun 07 13:17:11.151928 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: thunder lock: enabled Jun 07 13:17:11.151928 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 13:17:11.151928 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 13:17:11.196779 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: Python main interpreter initialized at 0x55efb11869c0 Jun 07 13:17:11.196779 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: python threads support enabled Jun 07 13:17:11.196779 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: your server socket listen backlog is limited to 100 connections Jun 07 13:17:11.196779 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: your mercy for graceful operations on workers is 90 seconds Jun 07 13:17:11.197205 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 13:17:11.197205 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: *** Operational MODE: preforking *** Jun 07 13:17:11.197463 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: *** uWSGI is running in multiple interpreter mode *** Jun 07 13:17:11.197463 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: spawned uWSGI master process (pid: 117829) Jun 07 13:17:11.197685 dv-cinder-844601-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 13:17:11.199322 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: spawned uWSGI worker 1 (pid: 117842, cores: 1) Jun 07 13:17:11.199322 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: spawned uWSGI worker 2 (pid: 117843, cores: 1) Jun 07 13:17:11.199322 dv-cinder-844601-3-iscsi devstack@n-api.service[117829]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 13:17:12.429311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:17:12.429918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:17:13.259165 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:17:13.259165 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: from cryptography.utils import int_from_bytes Jun 07 13:17:13.259495 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:17:13.259495 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: from cryptography.utils import int_from_bytes Jun 07 13:17:13.276179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:17:13.276179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: from cryptography.utils import int_from_bytes Jun 07 13:17:13.276815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:17:13.276815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: from cryptography.utils import int_from_bytes Jun 07 13:17:15.604470 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:17:15.605004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:17:15.605283 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:17:15.605542 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:17:15.605803 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:17:15.606195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.606528 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.606879 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.607203 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.607538 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.607854 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.608182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.608507 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.608843 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.609113 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.609435 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.609767 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-3-iscsi {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.610093 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.610407 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.610724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.611078 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.611387 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.611715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.612026 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.612531 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.614482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.614482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.614482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.614482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.614807 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.615081 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.615420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.615722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.616055 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.616371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.616777 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-3-iscsi {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.617095 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.617410 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.617733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.618149 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.618466 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.618783 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.619149 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.619478 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.619792 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.620125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.620450 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.620777 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.621096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.621403 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.621717 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.622031 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.622357 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.622666 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.623001 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.623259 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.623594 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.623904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.624231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.624560 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.624817 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.625072 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.625398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.625735 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.626037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.626351 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.626663 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.627001 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.627367 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.627684 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.627997 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.628692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.628692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.628956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.629263 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.630230 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.630785 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.630995 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.631245 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.631564 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.631912 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.632140 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:17:15.632607 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.632761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:17:15.632906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.632906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.633182 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:17:15.633332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.633502 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:17:15.633652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.633793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:17:15.633941 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.634090 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.634248 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.634397 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.634538 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.634687 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.634879 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.635040 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.635192 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.635334 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.635492 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.635647 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.635816 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.635970 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.636303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.636446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.636587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.636728 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.636879 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.637023 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.637176 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.637328 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.637480 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-3-iscsi {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.637623 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.637774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.637916 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.638084 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.638238 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.638380 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.638521 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.638677 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.638845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.639008 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.639151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.639342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.639497 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.639666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.639820 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.639820 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.640105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.640295 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.640454 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.640604 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.640756 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.640909 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.641062 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.641916 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.642083 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.642245 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.642390 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.642539 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.642689 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.642876 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.643039 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.643340 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.643507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.643660 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.643811 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.643968 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644075 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644168 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644261 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-3-iscsi {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644440 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644540 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644620 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644716 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644800 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644889 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.644889 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.645576 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.645576 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.645755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.645846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.645935 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.646113 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.646210 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.646435 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.646538 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.646746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.646861 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.647092 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.647182 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.647404 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.647496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.647715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.647819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.648025 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.648116 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.648327 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.648424 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.648634 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.648730 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.648942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.649030 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.649246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.649342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.649563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.649652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.649871 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.649969 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.650124 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.650215 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.650433 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.650523 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.650757 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.650881 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.651120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.651218 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.651471 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.651618 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.651740 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.651830 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.651987 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.652145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.652318 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.652503 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.652622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.652806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.652908 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.653146 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.653249 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.653481 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.653601 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.653801 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.653901 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.654112 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.654218 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.654420 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.654533 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.654729 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.654862 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.655061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.655161 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.655378 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.655488 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.655695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.655795 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.656022 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.656112 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.656333 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.656422 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.656655 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.656745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.656984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.657083 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.657293 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.657389 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.657603 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.657701 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.657930 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.658043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.658253 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.658345 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.658565 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.658665 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.658907 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.659001 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.659234 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.659335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.659548 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.659639 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.659857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.659961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.660168 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.660259 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.660491 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.660588 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.661396 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.661527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.661710 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.661811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.661967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.662085 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.662269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.662374 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.662596 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.662763 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.663025 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.663163 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.663264 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.663452 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.663611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.663770 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.663910 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.664057 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.664290 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.664428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.664578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.664723 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.664870 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.665009 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.665198 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.665287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.665443 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.665576 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.665738 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.665923 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.666024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.666105 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.666184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.666380 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.666501 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.666781 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.667126 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.667237 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.667449 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.667539 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.667761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.667856 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.668071 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.668152 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.668382 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.668484 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.668689 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.668772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.669008 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.669088 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.669325 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.669414 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.669633 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.669727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.670938 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.671283 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.671447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.671603 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.672184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.672422 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.672518 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.672613 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.672720 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.672815 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.672908 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.672992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.673075 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.673156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.673238 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.673350 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.673436 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.673518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.673607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.673690 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.673778 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.673877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.673967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.674058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.674148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.674230 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.674311 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.674407 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.674496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.674573 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.674663 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.674754 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.674861 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.674947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.675029 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.675224 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.675340 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.675537 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.675639 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.675859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.675960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.676180 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.676271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.676524 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.676628 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.676835 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.676933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.677157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:17:15.677254 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.677474 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.677571 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.677818 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.677908 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.678156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.678253 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.678469 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.678561 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.678802 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.678924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.679159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.679248 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.679480 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.679571 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.679790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.679887 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.680107 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.680197 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.680418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.680517 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.680728 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.680826 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.681037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.681137 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.681351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.681467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.681661 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.681747 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.682177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.682293 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.682383 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.682474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.682564 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.682654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.682886 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.682994 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.683219 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.683310 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.683540 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.683631 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.683852 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.683955 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.684161 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.684252 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.684469 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.684560 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.684794 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.684892 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.685119 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.685207 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.685472 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.685588 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.685786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.685981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.686114 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.686211 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.686441 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.686531 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.686759 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.686864 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.687109 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.687197 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.687432 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.687532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.687742 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.687831 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.688062 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.688159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.688377 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.688480 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.688698 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.688796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.689043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.689178 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.689340 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.689454 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.689653 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.689763 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.689968 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.690115 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.690270 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.690423 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.690595 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.690738 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.691008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.691101 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.691244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.691350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.691560 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.691651 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.691895 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.691991 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.692339 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.692460 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.692547 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.692642 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.692835 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.692933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.693142 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.693233 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.693448 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.693539 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.693752 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.693843 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.694063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.694154 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.694369 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.694467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.694704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.694794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.695044 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.695138 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.695353 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.695444 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.695679 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.695786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.695981 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.696086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.696293 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.696391 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.696606 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.696712 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.696915 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.697005 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.697218 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.697307 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.697532 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.697632 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.697846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.697937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.698153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.698244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.698476 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.698581 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.698789 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.698913 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.699121 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.699221 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.699437 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.699540 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.699747 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.699836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.700054 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.700145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.700361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.700451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.700670 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.700759 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.700983 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.701075 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.701297 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.701396 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.701605 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.701695 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.701913 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.702003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.702240 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.702502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.702599 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.702693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.702882 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.703057 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.703218 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.703362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.703503 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.703643 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.703826 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.703971 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.704148 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.704298 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.704465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.704604 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.704771 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.704918 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.705084 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.705221 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.705424 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.705526 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.705720 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.706032 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.706185 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.706333 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.706482 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.706628 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.706769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.706963 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.707106 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.707274 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.707410 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.708108 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.708255 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.708417 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.708565 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.708721 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.708861 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.709034 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.709182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.709351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.709487 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.709660 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.709798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.709966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.710115 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.710263 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.710410 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.710603 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.710753 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.710935 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.711081 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.711250 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.711389 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.711570 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.711711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.711890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.712030 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.712194 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.712371 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.712597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.712702 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.712829 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.712921 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.713144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.713241 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.713460 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.713549 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.713776 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.713867 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.714087 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.714218 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.714407 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.714525 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.714723 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.714811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.715056 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.715370 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.715461 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.715697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.715798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.716015 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.716106 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.716339 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.716430 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.716646 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.716746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.716966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.717057 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.717300 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.717391 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.717896 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.718000 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.718221 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.718342 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.718548 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.718654 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.718881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.718982 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.719196 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.719296 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.719509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.719601 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.719823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.719914 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.720134 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.720234 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.720446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.720546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.720755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.720855 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.721069 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.721172 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.721378 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.721468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.721688 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.721778 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.721998 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.722103 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.722308 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.722394 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.722716 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.722844 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.722951 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.723037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.723803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.723912 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.724123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.724239 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.724456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.724559 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.724768 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.724872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.725078 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.725201 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.725388 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.725489 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.725698 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.725787 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.726013 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.726104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.726327 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.726427 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.726635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.726725 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.726965 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.727077 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.727284 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.727384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.727602 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.727720 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.727915 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.728016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.728228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.728321 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.728536 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.728628 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.728854 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.728954 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.729168 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.729258 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.729483 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.729573 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.729788 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.729886 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.730097 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.730186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.730416 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.730508 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.730729 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.730847 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.731080 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.731171 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.731396 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.731488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.731704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.731794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.732012 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.732104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.732319 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.732435 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.732734 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.732937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.733029 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.733113 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.733230 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.733323 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.733534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.733624 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.733857 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.733957 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.734170 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.734271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.734475 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.734565 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.734787 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.734900 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.735120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.735239 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.735433 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.735525 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.735739 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.735828 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.736050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.736194 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.736357 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.736457 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.736673 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.736765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.736987 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.737092 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.737296 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.737391 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.737611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.737712 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.737925 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.738023 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.738233 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.738323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.738543 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.738642 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.738902 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.739011 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.739217 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.739315 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.739526 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.739622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.739837 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.739935 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.740144 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.740234 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.740458 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.740556 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.740770 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.740861 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.741087 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.741339 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.741438 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.741676 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.741782 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.741988 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.742084 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.742303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.742391 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.742727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.742864 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.743086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.743188 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.743274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.743356 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.743533 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.743626 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.743844 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.743943 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.744171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.744276 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.744484 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.744578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.744794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.744964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.745104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.745204 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.745412 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.745555 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.745719 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.745823 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.746027 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.746126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.746333 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.746426 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.746644 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.746745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.746973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.747126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.747281 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.747372 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.747588 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.747680 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.747893 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.747984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.748209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.748308 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.748513 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.748612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.748828 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.748919 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.749134 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.749233 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.749480 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.749645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.749794 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.749937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.750077 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.750386 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.750495 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.750688 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.750782 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.751053 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.751156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.751363 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.751455 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.751702 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.751793 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.752035 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.752127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.752383 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.752484 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.752696 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.752817 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.753160 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.753288 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.753393 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.753480 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.753619 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.753713 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.753926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.754019 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.754232 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.754327 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.754570 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.754662 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.754903 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.755014 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.755211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.755311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.755529 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.755686 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.755841 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.755943 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.756156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.756253 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.756467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.756566 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.756772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.756873 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.757083 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.757173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.757386 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.757481 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.757703 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.757804 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.758012 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.758101 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.758316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.758405 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.758620 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.758740 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.758959 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.759061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.759271 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.759362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.759575 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.759708 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.759885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.760030 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.760190 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.760350 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.760508 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.760664 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.760814 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.760983 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.761119 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.761301 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.761425 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.761626 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.761736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.761946 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.762037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.762257 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.762350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.762682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.762793 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.763071 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.763221 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.763428 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.763520 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.763603 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.763686 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.763872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.763972 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.764177 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.764269 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.764484 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.764581 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.764795 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.764888 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.765118 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.765211 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.765436 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.765536 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.765741 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.765845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.766053 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.766143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.766358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.766449 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.766663 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.766767 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.766991 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.767121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.767301 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.767446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.767604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.767763 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.767909 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.768189 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.768289 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.768504 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.768600 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.768850 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.768986 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.769127 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.769246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.769441 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.769542 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.769746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.769844 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.770572 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.770674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.770897 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.771016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.771238 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.771328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.771544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.771641 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.771892 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.771994 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.772197 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.772293 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.772515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.772613 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.772824 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.772926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.773141 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.773305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.773479 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.773577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.773769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.773881 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.774076 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.774169 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.774394 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.774508 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.774710 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.774849 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.775047 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.775180 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.775355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.775511 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.775665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.775843 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.775990 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.776155 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.776306 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.776468 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.776626 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.776781 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.776949 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.777086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.777275 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.777420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.777602 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.777737 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.777910 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.778046 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.778222 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.778372 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.778539 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.778681 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.778865 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.778962 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.779184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.779293 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.779502 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.779593 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.779817 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.779908 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.780134 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.780239 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.780450 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.780549 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.780767 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.780859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.781080 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.781178 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.781388 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.781481 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.781721 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.781852 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.782022 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.782117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.782308 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.782398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.782627 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.782715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.782960 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.783067 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.783272 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.783386 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.783586 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.783704 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.783892 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.783991 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.784205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.784303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.784511 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.784603 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.784874 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.784965 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.785192 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.785291 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.785533 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.785625 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.786379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.786483 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.786700 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.786984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.787162 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.787258 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.787350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.787435 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.787652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.787751 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.787960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.788051 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.788275 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.788371 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.788587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.788691 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.788908 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.789040 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.789213 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.789326 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.789528 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.789631 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.789838 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.789937 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.790149 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.790249 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.790459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.790565 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.790775 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.790898 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.791106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.791208 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.791414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.791508 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.791737 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.791826 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.792043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.792141 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.792354 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.792445 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.792663 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.792764 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.793014 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.793105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.793338 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.793429 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.793707 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.793871 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.794017 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.794167 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.794308 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.794456 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.794616 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.794759 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.794960 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.795079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.795294 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.795395 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.795619 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.795710 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.795935 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.796034 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.796248 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.796338 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.796573 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.796692 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.796897 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.797012 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.797210 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.797333 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.797526 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.797634 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.797833 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.797937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.798155 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.798247 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.798478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.798569 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.798795 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.798929 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.799142 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.799351 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.799563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.799689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.799890 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.800012 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.800205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.800332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.800527 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.800652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.800856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.800975 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.801163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.801317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.801985 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.802127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.802301 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.802447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.802611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.802763 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.802941 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.803104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.803268 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.803445 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.803577 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.803804 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.803920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.804099 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.804193 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.804443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.804536 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.804765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.804861 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.805079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.805179 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.805397 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.805489 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.805700 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.805804 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.806026 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.806120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.806341 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.806432 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.806663 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.806767 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.807007 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.807101 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.807315 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.807412 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.807635 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.807744 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.807945 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.808044 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.808252 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.808343 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.808558 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.808658 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.808864 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.808963 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.809179 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.809278 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.809494 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.809594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.809811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.809912 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.810130 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.810221 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.810459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.810553 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.810769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.810890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.811130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.811232 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.811460 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.811560 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.811781 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.811872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.812104 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.812210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.812435 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.812639 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.812739 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.812964 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.813055 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.813304 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.813405 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.813636 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.813748 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.813943 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.814055 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.814249 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.814341 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.814561 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.814653 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.814886 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.814996 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.815196 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.815295 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.815502 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.815602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.815829 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.815935 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.816136 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.816245 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.816443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.816561 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.816831 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.817583 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.817705 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.817798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.817891 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.817983 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.818202 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.818296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.818535 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.818634 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.818864 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.819110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.819225 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.819476 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.819569 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.819804 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.819895 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.820138 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.820236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.820467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.820599 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.820778 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.820878 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.821090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.821189 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.821407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.821498 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.821726 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.821819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.822039 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.822130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.822355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.822446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.822673 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.822772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.823030 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.823123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.823341 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.823431 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.823673 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.823779 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.824024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.824167 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.824264 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.824348 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.824574 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.824803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.824905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.825141 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.825241 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.825463 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.825556 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.825785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.825879 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.826101 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.826190 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.826420 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.826511 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.826729 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.826821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.827065 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.827162 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.827378 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.827482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.827684 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.827821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.827998 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.828095 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.828305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.828395 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.828620 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.828728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.828930 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.829023 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.829248 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.829350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.829558 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.829649 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.829871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.829975 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.830200 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.830305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.830516 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.830625 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.830879 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.831010 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.831192 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.831298 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.831507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.831599 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.831821 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.831913 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.832135 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.832235 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.832449 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.832559 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.832788 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.832888 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.833102 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.833203 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.833414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.833506 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.833747 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.833986 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.834233 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.834388 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.834540 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.834689 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.834887 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.835111 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.835256 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.835416 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.835564 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.835730 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.835874 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.836026 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.836167 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.836307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.836468 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.836608 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.836751 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.836905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.837045 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.837190 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.837341 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.837482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.837640 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.837780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.837979 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.838126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.838308 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.838446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.838635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.838776 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.838977 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.839164 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.839301 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.839494 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.839743 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.839838 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.839920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.840124 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.840228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.840443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.840545 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.840761 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.840844 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.841084 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.841166 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.841440 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.841520 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.841751 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.841832 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.842056 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.842144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.842378 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.842468 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.842976 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.843079 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.843312 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.843732 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.843853 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.843941 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.844014 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.844178 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.844364 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.844518 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.844641 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.844817 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.844980 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.845135 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.845303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.845444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.845617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.845770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.846045 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.846144 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.846371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.846476 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.846687 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.846778 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.847051 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.847214 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.847362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.847506 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.847664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.847756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.847978 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.848117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.848802 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.848904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.849109 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.849236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.849430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.849558 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.849738 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.849899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.850069 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.850246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.850378 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.850584 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.850684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.850943 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.851041 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.851262 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.851355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.851577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.851686 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.851889 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.851989 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.852195 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.852287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.852500 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.852600 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.852813 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.852905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.853117 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.853217 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.853426 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.853519 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.853728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.853820 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.854042 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.854134 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.854350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.854458 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.854698 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.854812 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.854977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.855080 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.855298 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.855399 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.855609 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.855710 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.855920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.856025 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.856228 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.856327 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.856538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.856631 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.856847 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.856951 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.857159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.857260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.857469 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.857569 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.857779 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.857879 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.858092 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.858228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.858401 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.858652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.858757 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.859019 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.859124 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.859352 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.859445 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.859690 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.859800 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.860012 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.860103 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.860325 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.860416 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.860634 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.860745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.860942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.861034 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.861267 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.861367 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.861581 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.861682 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.861895 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.861987 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.862207 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.862306 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.862520 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.862612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.862879 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.862989 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.863168 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.863267 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.863483 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.863578 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.863820 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.863940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.864741 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.864850 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.864988 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.865089 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.865304 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.865404 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.865617 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.865793 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.865932 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.866023 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.866250 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.866349 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.866595 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.866701 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.866945 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.867041 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.867272 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.867376 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.867594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.867698 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.867915 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.868014 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.868228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.868366 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.868540 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.868643 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.868853 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.868945 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.869165 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.869266 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.869489 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.869618 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.869811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.869911 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.870126 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.870217 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.870432 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.870526 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.870775 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.870913 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.871139 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.871240 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.871463 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.871557 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.871798 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.871889 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.872113 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.872214 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.872438 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.872531 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.872764 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.872864 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.873079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.873181 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.873403 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.873503 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.873715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.873814 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.874049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.874154 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.874366 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.874465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.874648 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:17:15.874924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.875042 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.875342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.875650 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.875956 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.876268 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.876590 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.876901 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.877208 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.877513 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.877822 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.878127 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.878432 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.878736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.879063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.879495 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.879709 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.880013 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.880317 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.880622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.880928 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.881232 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.881541 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.881845 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.882149 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.882451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.882755 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.883082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.883414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.883746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.884063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.884387 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.884769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.885026 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.885335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.885659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.885986 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.886299 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.886609 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.886962 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.887275 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.887589 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.887905 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.888216 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.888527 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.888856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.889167 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.889503 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.889812 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.890137 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.890461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.890786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.891126 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.891440 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.891774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.892089 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.892402 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.892723 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.893037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.893352 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.893671 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.893993 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.894324 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.894654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.894994 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.895346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.895676 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.896028 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.896346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.896694 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.897025 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.897342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.897657 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.897968 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:17:15.898214 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:17:15.935496 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO dbcounter [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Registered counter for database nova_api Jun 07 13:17:15.955182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_db.sqlalchemy.engines [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:17:15.958868 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO dbcounter [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Registered counter for database nova_api Jun 07 13:17:15.961711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writer thread running {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:17:15.979168 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_db.sqlalchemy.engines [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:17:15.985541 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writer thread running {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:17:16.019125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.context [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4(cell1) {{(pid=117842) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:17:16.023297 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:16.024884 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:16.025710 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:16.027738 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:16.029730 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO dbcounter [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Registered counter for database nova_cell0 Jun 07 13:17:16.035137 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO dbcounter [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Registered counter for database nova_cell1 Jun 07 13:17:16.042543 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.context [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4(cell1) {{(pid=117843) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:17:16.044541 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_db.sqlalchemy.engines [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:17:16.045744 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_db.sqlalchemy.engines [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:17:16.046957 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:16.048407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:16.049237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:16.051220 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:16.053807 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO dbcounter [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Registered counter for database nova_cell0 Jun 07 13:17:16.053967 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writer thread running {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:17:16.054318 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writer thread running {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:17:16.059292 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO dbcounter [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Registered counter for database nova_cell1 Jun 07 13:17:16.066619 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_db.sqlalchemy.engines [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:17:16.068906 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_db.sqlalchemy.engines [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:17:16.073704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writer thread running {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:17:16.202330 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO dbcounter [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Registered counter for database nova_cell0 Jun 07 13:17:16.210181 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_db.sqlalchemy.engines [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:17:16.214775 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writer thread running {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:17:16.215586 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writer thread running {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:17:16.226792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO dbcounter [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Registered counter for database nova_cell0 Jun 07 13:17:16.233611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_db.sqlalchemy.engines [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:17:16.238351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writer thread running {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:17:16.655150 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: WARNING keystonemiddleware.auth_token [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:17:16.663080 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: WARNING keystonemiddleware.auth_token [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:17:16.678703 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: WARNING keystonemiddleware.auth_token [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:17:16.686122 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: WARNING keystonemiddleware.auth_token [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:17:16.888470 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: WARNING keystonemiddleware.auth_token [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:17:16.894519 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: WARNING keystonemiddleware.auth_token [None req-3b32d9ef-6707-4eab-8e31-483c882e88cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:17:16.900331 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55efb11869c0 pid: 117842 (default app) Jun 07 13:17:16.916445 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: WARNING keystonemiddleware.auth_token [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:17:16.922405 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: WARNING keystonemiddleware.auth_token [None req-4c8ad0c1-e7f0-4a1c-a142-95f18eba4f60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:17:16.928060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55efb11869c0 pid: 117843 (default app) Jun 07 13:17:56.532565 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:56.534199 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:56.535524 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:56.536875 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:57.292556 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:57.293811 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:57.294646 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:57.295722 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:57.590880 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-931e757e-4a3c-43c0-88d0-58f9dc55d033 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Action: 'create', calling method: .version_select at 0x7f46a960d5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1333126832", "metadata": {"Type": "work"}}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-931e757e-4a3c-43c0-88d0-58f9dc55d033 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Request method failure captured: Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 122 Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1AESGpDEU_uvAM-ijMMdJP67CvcYDS_zDoqKh9MSrkpsn9QIqKMM_mKmJt9o6mSws1GboOir4QABh3IfkVCsMb98nVkXYvPAwrg7tL5E6HNjX276gx8H3wNdlkOIn3MNX6ueeJnKbsqZeR52I8Wxmz9uqnJ7rMHZcq5kZFF1MJR38Y Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:17:57.623243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 07469976d61a438a92ed6d348621f032 Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1333126832", "metadata": {"Type": "work"}}} Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: Jun 07 13:17:57.624906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1333126832', 'metadata': {'Type': 'work'}}}} Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise error Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:17:57.625992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 13:17:57.627652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 13:17:57.629046 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 13:17:57.629046 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.629046 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-931e757e-4a3c-43c0-88d0-58f9dc55d033 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:17:57.629046 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-931e757e-4a3c-43c0-88d0-58f9dc55d033 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.104346 Jun 07 13:17:57.631181 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Jun 7 13:17:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:17:57.636219 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5aa8cbe2-c502-489c-a1f2-368b24bb34c6 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Action: 'create', calling method: .version_select at 0x7f46a961f940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-168648713", "metadata": {"Type": "work"}}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5aa8cbe2-c502-489c-a1f2-368b24bb34c6 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Request method failure captured: Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 119 Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1AESGpDEU_uvAM-ijMMdJP67CvcYDS_zDoqKh9MSrkpsn9QIqKMM_mKmJt9o6mSws1GboOir4QABh3IfkVCsMb98nVkXYvPAwrg7tL5E6HNjX276gx8H3wNdlkOIn3MNX6ueeJnKbsqZeR52I8Wxmz9uqnJ7rMHZcq5kZFF1MJR38Y Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:17:57.638871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 07469976d61a438a92ed6d348621f032 Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-168648713", "metadata": {"Type": "work"}}} Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: Jun 07 13:17:57.640385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-168648713', 'metadata': {'Type': 'work'}}}} Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise error Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi '0' Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:17:57.641225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 13:17:57.642550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 13:17:57.643729 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 13:17:57.643729 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.643729 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5aa8cbe2-c502-489c-a1f2-368b24bb34c6 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:17:57.643729 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5aa8cbe2-c502-489c-a1f2-368b24bb34c6 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007976 Jun 07 13:17:57.643729 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 2/2] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Jun 7 13:17:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:17:57.649176 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-450c0fc7-a624-4b83-8d33-849418849b4e tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Action: 'create', calling method: .version_select at 0x7f46a960d940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1923362772", "metadata": {"Type": "work"}}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-450c0fc7-a624-4b83-8d33-849418849b4e tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Request method failure captured: Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 119 Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1AESGpDEU_uvAM-ijMMdJP67CvcYDS_zDoqKh9MSrkpsn9QIqKMM_mKmJt9o6mSws1GboOir4QABh3IfkVCsMb98nVkXYvPAwrg7tL5E6HNjX276gx8H3wNdlkOIn3MNX6ueeJnKbsqZeR52I8Wxmz9uqnJ7rMHZcq5kZFF1MJR38Y Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:17:57.651415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 07469976d61a438a92ed6d348621f032 Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1923362772", "metadata": {"Type": "work"}}} Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: Jun 07 13:17:57.652689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1923362772', 'metadata': {'Type': 'work'}}}} Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise error Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi '' Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:17:57.653441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 13:17:57.654718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 13:17:57.655965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 13:17:57.655965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:57.655965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-450c0fc7-a624-4b83-8d33-849418849b4e tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:17:57.655965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-450c0fc7-a624-4b83-8d33-849418849b4e tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007042 Jun 07 13:17:57.655965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 3/3] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Jun 7 13:17:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:17:57.663518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-26a7f838-9daa-43e9-9afd-4dbe57b6ee3a tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Calling method '.version_select at 0x7f46a95395e0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:58.117207 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e7663a86-0e94-4e1f-a16f-86b786e9a8b4 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] Action: 'create', calling method: .version_select at 0x7f46a960d5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1938164512", "metadata": {"Type": "work"}}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:58.559431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-26a7f838-9daa-43e9-9afd-4dbe57b6ee3a tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] HTTP exception thrown: Volume tempest-invalid-854963339 could not be found. Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-26a7f838-9daa-43e9-9afd-4dbe57b6ee3a tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Request method failure captured: Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-854963339 HTTP/1.1 Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1AESGpDEU_uvAM-ijMMdJP67CvcYDS_zDoqKh9MSrkpsn9QIqKMM_mKmJt9o6mSws1GboOir4QABh3IfkVCsMb98nVkXYvPAwrg7tL5E6HNjX276gx8H3wNdlkOIn3MNX6ueeJnKbsqZeR52I8Wxmz9uqnJ7rMHZcq5kZFF1MJR38Y Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:17:58.563236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 07469976d61a438a92ed6d348621f032 Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Volume tempest-invalid-854963339 could not be found. Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': 'tempest-invalid-854963339'} Jun 07 13:17:58.564794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-854963339 could not be found. (HTTP 404) (Request-ID: req-9b209e69-d042-49ca-89d8-bb4e84068b27) Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:58.565733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:17:58.568961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-854963339 could not be found. Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:17:58.571981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-854963339 could not be found. Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-854963339 could not be found. Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-26a7f838-9daa-43e9-9afd-4dbe57b6ee3a tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Returning 404 to user: Volume tempest-invalid-854963339 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-26a7f838-9daa-43e9-9afd-4dbe57b6ee3a tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-854963339" status: 404 len: 98 microversion: 2.1 time: 0.907478 Jun 07 13:17:58.575324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 4/4] 10.222.0.61 () {58 vars in 1214 bytes} [Tue Jun 7 13:17:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-854963339 => generated 98 bytes in 909 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 07 13:17:59.065569 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-21b62394-cdd8-4942-b11e-82604617905b tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Action: 'create', calling method: .version_select at 0x7f46a9469040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-702622254"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:00.564787 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e7663a86-0e94-4e1f-a16f-86b786e9a8b4 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.277478 Jun 07 13:18:00.565377 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 1/5] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Jun 7 13:17:57 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3280 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 13:18:00.570617 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3db992a1-4962-4b8a-9c7a-0a7de536b4bb tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003933 Jun 07 13:18:00.579156 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 2/6] 10.222.0.61 () {58 vars in 1139 bytes} [Tue Jun 7 13:18:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 13:18:00.584492 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8325baf3-d468-40b9-ab5e-65a1c37ee911 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] Calling method '.version_select at 0x7f46a94d5820>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:00.857440 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8325baf3-d468-40b9-ab5e-65a1c37ee911 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435" status: 200 len: 353 microversion: 2.1 time: 0.277103 Jun 07 13:18:00.862774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 3/7] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:00 2022] GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435 => generated 353 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:00.867711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-804fa5df-16cb-4b52-b96a-85cc230ebcc6 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003757 Jun 07 13:18:00.868215 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1136 bytes} [Tue Jun 7 13:18:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 13:18:01.055679 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-178911830", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "networks": [{"uuid": "fb555a21-8403-4680-aa16-d8cb04661740"}]}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:01.285282 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] validate_networks() for [('fb555a21-8403-4680-aa16-d8cb04661740', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:18:01.375671 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-21b62394-cdd8-4942-b11e-82604617905b tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.800351 Jun 07 13:18:01.376578 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 5/9] 10.222.0.61 () {60 vars in 1154 bytes} [Tue Jun 7 13:17:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2808 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 13:18:01.388564 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-602c6a57-c3e5-4da3-a954-ba1579e17418 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Calling method '.version_select at 0x7f46a9469700>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:01.454148 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-602c6a57-c3e5-4da3-a954-ba1579e17418 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] HTTP exception thrown: Volume 1949d6a5-f274-4314-8b4f-80ee84699fb2 could not be found. Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-602c6a57-c3e5-4da3-a954-ba1579e17418 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Request method failure captured: Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/os-volumes/1949d6a5-f274-4314-8b4f-80ee84699fb2 HTTP/1.1 Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1AESGpDEU_uvAM-ijMMdJP67CvcYDS_zDoqKh9MSrkpsn9QIqKMM_mKmJt9o6mSws1GboOir4QABh3IfkVCsMb98nVkXYvPAwrg7tL5E6HNjX276gx8H3wNdlkOIn3MNX6ueeJnKbsqZeR52I8Wxmz9uqnJ7rMHZcq5kZFF1MJR38Y Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:18:01.457332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-VolumesNegativeTest-1561702166 Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 07469976d61a438a92ed6d348621f032 Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Volume 1949d6a5-f274-4314-8b4f-80ee84699fb2 could not be found. Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '1949d6a5-f274-4314-8b4f-80ee84699fb2'} Jun 07 13:18:01.463127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1949d6a5-f274-4314-8b4f-80ee84699fb2 could not be found. (HTTP 404) (Request-ID: req-ff81a3cf-96ec-42cb-b3c6-2010a73a80d1) Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:01.465335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:18:01.468724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1949d6a5-f274-4314-8b4f-80ee84699fb2 could not be found. Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 13:18:01.472177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1949d6a5-f274-4314-8b4f-80ee84699fb2 could not be found. Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1949d6a5-f274-4314-8b4f-80ee84699fb2 could not be found. Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-602c6a57-c3e5-4da3-a954-ba1579e17418 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Returning 404 to user: Volume 1949d6a5-f274-4314-8b4f-80ee84699fb2 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-602c6a57-c3e5-4da3-a954-ba1579e17418 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/1949d6a5-f274-4314-8b4f-80ee84699fb2" status: 404 len: 109 microversion: 2.1 time: 0.081622 Jun 07 13:18:01.475509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 6/10] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:18:01 2022] DELETE /compute/v2.1/os-volumes/1949d6a5-f274-4314-8b4f-80ee84699fb2 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:18:01.479326 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f7965805-c818-4e8a-a505-da85fa9b7ca0 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a9469f70>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:01.555917 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f7965805-c818-4e8a-a505-da85fa9b7ca0 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828" status: 200 len: 344 microversion: 2.1 time: 0.092618 Jun 07 13:18:01.556558 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 7/11] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:01 2022] GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:01.561823 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fef0b453-2ed4-48dc-97c8-962a7dadc730 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Calling method '.version_select at 0x7f46a9469280>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:01.620362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-fef0b453-2ed4-48dc-97c8-962a7dadc730 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] HTTP exception thrown: Volume 5c9974e5-fac4-4fcc-a0ae-c44a4e296574 could not be found. Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fef0b453-2ed4-48dc-97c8-962a7dadc730 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Request method failure captured: Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/os-volumes/5c9974e5-fac4-4fcc-a0ae-c44a4e296574 HTTP/1.1 Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1AESGpDEU_uvAM-ijMMdJP67CvcYDS_zDoqKh9MSrkpsn9QIqKMM_mKmJt9o6mSws1GboOir4QABh3IfkVCsMb98nVkXYvPAwrg7tL5E6HNjX276gx8H3wNdlkOIn3MNX6ueeJnKbsqZeR52I8Wxmz9uqnJ7rMHZcq5kZFF1MJR38Y Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:18:01.622420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3408ff2ea39d4c428a122846f19a6809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-VolumesNegativeTest-1561702166 Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 3408ff2ea39d4c428a122846f19a6809 Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-VolumesNegativeTest-1561702166 Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 07469976d61a438a92ed6d348621f032 Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-VolumesNegativeTest-1561702166-project Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Volume 5c9974e5-fac4-4fcc-a0ae-c44a4e296574 could not be found. Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '5c9974e5-fac4-4fcc-a0ae-c44a4e296574'} Jun 07 13:18:01.624371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c9974e5-fac4-4fcc-a0ae-c44a4e296574 could not be found. (HTTP 404) (Request-ID: req-ab34d203-94ce-44a5-baaf-d10030a13be6) Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:01.625346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:01.626465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c9974e5-fac4-4fcc-a0ae-c44a4e296574 could not be found. Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:18:01.627568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c9974e5-fac4-4fcc-a0ae-c44a4e296574 could not be found. Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c9974e5-fac4-4fcc-a0ae-c44a4e296574 could not be found. Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fef0b453-2ed4-48dc-97c8-962a7dadc730 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] Returning 404 to user: Volume 5c9974e5-fac4-4fcc-a0ae-c44a4e296574 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fef0b453-2ed4-48dc-97c8-962a7dadc730 tempest-VolumesNegativeTest-1561702166 tempest-VolumesNegativeTest-1561702166-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/5c9974e5-fac4-4fcc-a0ae-c44a4e296574" status: 404 len: 109 microversion: 2.1 time: 0.065976 Jun 07 13:18:01.628647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 8/12] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:01 2022] GET /compute/v2.1/os-volumes/5c9974e5-fac4-4fcc-a0ae-c44a4e296574 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:18:01.871053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7ca5bd94-6358-4798-b538-ae7d900c1e87 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] Calling method '.version_select at 0x7f46a94698b0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:01.984705 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7ca5bd94-6358-4798-b538-ae7d900c1e87 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435" status: 200 len: 354 microversion: 2.1 time: 0.118178 Jun 07 13:18:01.985583 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 9/13] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:01 2022] GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:01.998439 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a3e31557-94ee-4f06-a851-c3e2067fe6fb tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] Calling method '.version_select at 0x7f46a9469940>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:02.100943 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a3e31557-94ee-4f06-a851-c3e2067fe6fb tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435" status: 200 len: 354 microversion: 2.1 time: 0.106638 Jun 07 13:18:02.101653 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 10/14] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:01 2022] GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:02.124207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8bcd1d92-708e-45f5-bb3f-1ca348c5917f tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] Calling method '.version_select at 0x7f46a9469790>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:02.292938 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8bcd1d92-708e-45f5-bb3f-1ca348c5917f tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435" status: 202 len: 0 microversion: 2.1 time: 0.174217 Jun 07 13:18:02.294084 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 11/15] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:18:02 2022] DELETE /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:18:02.308540 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fac6b7af-4501-4fd6-8eb4-e89b3fd08626 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] Calling method '.version_select at 0x7f46a947f160>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:02.383487 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fac6b7af-4501-4fd6-8eb4-e89b3fd08626 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435" status: 200 len: 353 microversion: 2.1 time: 0.083973 Jun 07 13:18:02.390598 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 12/16] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:02 2022] GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:02.569462 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-eb508d69-b1cf-4378-9281-627e2425307f tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a947f820>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:02.699055 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-eb508d69-b1cf-4378-9281-627e2425307f tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828" status: 200 len: 345 microversion: 2.1 time: 0.134002 Jun 07 13:18:02.701133 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 13/17] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:02 2022] GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:02.719747 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-77f83b8b-e4d8-4a52-9d3f-22a4e398e0e8 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Action: 'create', calling method: .version_select at 0x7f46a9469ca0>, body: {"snapshot": {"volume_id": "37d319bd-ad3d-478c-b16c-ffaadca40828", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-165600902"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:02.786879 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:18:02.787967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:18:02.788607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:18:02.789234 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:18:02.789778 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:18:02.834445 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.834936 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.835757 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.836190 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.930756 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Getting quotas for project 7b95f79de5724987ab6c9fddb86a84f0. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:18:02.948068 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Getting quotas for user 106d1325381147b1ba157f2d54d0388c and project 7b95f79de5724987ab6c9fddb86a84f0. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:18:02.981573 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:18:02.985751 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:18:03.154414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5d8ce04a-45e9-4329-9fff-3dc41dd377f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.284588 Jun 07 13:18:03.163030 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 5/18] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:18:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:18:03.173423 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a79f7e56-5c9d-4220-ad6c-92d42633075d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:03.174235 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a79f7e56-5c9d-4220-ad6c-92d42633075d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:03.260373 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-77f83b8b-e4d8-4a52-9d3f-22a4e398e0e8 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.551613 Jun 07 13:18:03.261229 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 14/19] 10.222.0.61 () {60 vars in 1161 bytes} [Tue Jun 7 13:18:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:03.271673 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-70f2fe35-5c5b-4cfc-b523-8cde351d654f tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a947fb80>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:03.330267 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a79f7e56-5c9d-4220-ad6c-92d42633075d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:03.388690 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a79f7e56-5c9d-4220-ad6c-92d42633075d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1214 microversion: 2.1 time: 0.211061 Jun 07 13:18:03.390081 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 6/20] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:03 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:03.408964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f549740c-369f-4666-b3ea-3118ad86af03 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] Calling method '.version_select at 0x7f46a93fe670>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:03.467646 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-70f2fe35-5c5b-4cfc-b523-8cde351d654f tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 200 len: 286 microversion: 2.1 time: 0.200711 Jun 07 13:18:03.469071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 15/21] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Jun 7 13:18:03 2022] GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 286 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:03.478813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a126085f-7cf6-4c4f-814b-190ab447b94c tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a947f430>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-f549740c-369f-4666-b3ea-3118ad86af03 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] HTTP exception thrown: Volume 0a1258c5-f4c2-45b8-969f-f06e0f7d2435 could not be found. Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f549740c-369f-4666-b3ea-3118ad86af03 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] Request method failure captured: Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435 HTTP/1.1 Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1AFIVtosu23OniY2gyq7pTnLngvCsv2HcyDI1-BbhrxrN2r_hEZ6Uh3VjCbNbu0CJ5PrDqPQgs6vadjIy6cJUjh7Dy2oHfZ8aZwg-b7ffiJu4w4HnC2nGuJsOqKIVO9nhYSV3J7wYZZmO3nRwXpZpPZ-pQZnz_hWYCzpxk0dTK0Tio Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 56cf49983d984317b26f02dc0502e674 Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-VolumesGetTestJSON-1510657522 Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:18:03.515323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/56cf49983d984317b26f02dc0502e674"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/56cf49983d984317b26f02dc0502e674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/56cf49983d984317b26f02dc0502e674"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_56cf49983d984317b26f02dc0502e674"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-VolumesGetTestJSON-1510657522 Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 56cf49983d984317b26f02dc0502e674 Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-VolumesGetTestJSON-1510657522 Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-VolumesGetTestJSON-1510657522-project Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: f9a3f501edab44559d30080706179006 Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-VolumesGetTestJSON-1510657522-project Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Volume 0a1258c5-f4c2-45b8-969f-f06e0f7d2435 could not be found. Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '0a1258c5-f4c2-45b8-969f-f06e0f7d2435'} Jun 07 13:18:03.522786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a1258c5-f4c2-45b8-969f-f06e0f7d2435 could not be found. (HTTP 404) (Request-ID: req-52cccd6b-6c4c-4144-ac7f-1bbf7e0d41f1) Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:03.524953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:03.527544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a1258c5-f4c2-45b8-969f-f06e0f7d2435 could not be found. Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:18:03.529973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a1258c5-f4c2-45b8-969f-f06e0f7d2435 could not be found. Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a1258c5-f4c2-45b8-969f-f06e0f7d2435 could not be found. Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f549740c-369f-4666-b3ea-3118ad86af03 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] Returning 404 to user: Volume 0a1258c5-f4c2-45b8-969f-f06e0f7d2435 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f549740c-369f-4666-b3ea-3118ad86af03 tempest-VolumesGetTestJSON-1510657522 tempest-VolumesGetTestJSON-1510657522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435" status: 404 len: 109 microversion: 2.1 time: 0.119213 Jun 07 13:18:03.532666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 7/22] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:03 2022] GET /compute/v2.1/os-volumes/0a1258c5-f4c2-45b8-969f-f06e0f7d2435 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:18:03.559425 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a126085f-7cf6-4c4f-814b-190ab447b94c tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.084503 Jun 07 13:18:03.560259 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 16/23] 10.222.0.61 () {58 vars in 1139 bytes} [Tue Jun 7 13:18:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:03.575270 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0e5c9964-0240-4421-b590-8c6a5e7769f8 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a837a820>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:03.645035 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0e5c9964-0240-4421-b590-8c6a5e7769f8 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 200 len: 286 microversion: 2.1 time: 0.078025 Jun 07 13:18:03.649101 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 8/24] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Jun 7 13:18:03 2022] GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:04.410231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c11563b7-65a5-4522-8a07-6eff006f3cdf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:04.411648 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c11563b7-65a5-4522-8a07-6eff006f3cdf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:04.665489 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-568ea3c4-0a04-423c-a812-878008b51c1a tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a837af70>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:04.733245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-568ea3c4-0a04-423c-a812-878008b51c1a tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 200 len: 286 microversion: 2.1 time: 0.072652 Jun 07 13:18:04.737248 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 9/25] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Jun 7 13:18:04 2022] GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:04.911520 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c11563b7-65a5-4522-8a07-6eff006f3cdf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:04.938913 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c11563b7-65a5-4522-8a07-6eff006f3cdf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1214 microversion: 2.1 time: 0.534182 Jun 07 13:18:04.940333 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 17/26] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:04 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1214 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:05.744916 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-60bb36f8-9763-4d35-9bce-27ef0b8cc1b6 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a837ab80>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:05.896836 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-60bb36f8-9763-4d35-9bce-27ef0b8cc1b6 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 200 len: 286 microversion: 2.1 time: 0.154284 Jun 07 13:18:05.897679 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 10/27] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Jun 7 13:18:05 2022] GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:05.955961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a047334f-e988-4c38-84eb-7ff5baf9d0f6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:05.956580 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a047334f-e988-4c38-84eb-7ff5baf9d0f6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:05.970871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a047334f-e988-4c38-84eb-7ff5baf9d0f6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:05.971567 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a047334f-e988-4c38-84eb-7ff5baf9d0f6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:05.972075 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a047334f-e988-4c38-84eb-7ff5baf9d0f6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:05.972508 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a047334f-e988-4c38-84eb-7ff5baf9d0f6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:06.297098 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a047334f-e988-4c38-84eb-7ff5baf9d0f6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:06.317961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a047334f-e988-4c38-84eb-7ff5baf9d0f6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1218 microversion: 2.1 time: 0.365631 Jun 07 13:18:06.319084 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 18/28] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:05 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1218 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:06.908298 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e76f6448-7840-4b63-9ace-7b056f253a46 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a8304040>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:07.055530 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e76f6448-7840-4b63-9ace-7b056f253a46 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 200 len: 287 microversion: 2.1 time: 0.151207 Jun 07 13:18:07.056358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 11/29] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Jun 7 13:18:06 2022] GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:07.066163 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1dfb1d20-1c66-4bac-9e14-500703045e07 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a93b53a0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:07.335226 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3d920151-1c30-4f22-b10d-97927630df16 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:07.336084 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3d920151-1c30-4f22-b10d-97927630df16 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:07.354857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3d920151-1c30-4f22-b10d-97927630df16 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.363058 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3d920151-1c30-4f22-b10d-97927630df16 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.364803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3d920151-1c30-4f22-b10d-97927630df16 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.369601 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3d920151-1c30-4f22-b10d-97927630df16 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.915238 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1dfb1d20-1c66-4bac-9e14-500703045e07 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 202 len: 0 microversion: 2.1 time: 0.852589 Jun 07 13:18:07.915817 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 19/30] 10.222.0.61 () {58 vars in 1253 bytes} [Tue Jun 7 13:18:07 2022] DELETE /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 0 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:18:07.924095 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3578f2d9-d71b-4afc-907a-5616f9ca8d65 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a93b5b80>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:08.158370 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3578f2d9-d71b-4afc-907a-5616f9ca8d65 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 200 len: 286 microversion: 2.1 time: 0.237821 Jun 07 13:18:08.159260 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 20/31] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Jun 7 13:18:07 2022] GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 286 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:08.337212 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3d920151-1c30-4f22-b10d-97927630df16 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:08.357017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3d920151-1c30-4f22-b10d-97927630df16 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1266 microversion: 2.1 time: 1.025547 Jun 07 13:18:08.367935 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 12/32] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:07 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1266 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:09.173020 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fa0c866a-393e-4255-94a4-104ef0f9ba2a tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a93b58b0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:09.225106 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fa0c866a-393e-4255-94a4-104ef0f9ba2a tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 200 len: 286 microversion: 2.1 time: 0.055839 Jun 07 13:18:09.225960 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 21/33] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Jun 7 13:18:09 2022] GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:09.384983 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-31f63d6a-e42b-4ff9-8f35-25b4d558a435 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:09.385637 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-31f63d6a-e42b-4ff9-8f35-25b4d558a435 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:09.404478 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-31f63d6a-e42b-4ff9-8f35-25b4d558a435 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.404931 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-31f63d6a-e42b-4ff9-8f35-25b4d558a435 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.405714 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-31f63d6a-e42b-4ff9-8f35-25b4d558a435 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.406145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-31f63d6a-e42b-4ff9-8f35-25b4d558a435 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.542713 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-31f63d6a-e42b-4ff9-8f35-25b4d558a435 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:09.555794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-31f63d6a-e42b-4ff9-8f35-25b4d558a435 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1272 microversion: 2.1 time: 0.174627 Jun 07 13:18:09.556862 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 22/34] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:09 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:09.800661 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-debbd90c-b496-4c24-bded-7221e40cd3dc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: .version_select at 0x7f46a8294c10>, body: {"keypair": {"name": "tempest-keypair-22118456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGAaool5KhHwl99pPvr+W2ECfz5lFhu7Tlwxb4EzFkCQRean1CTWwElVkB5s73srYz9K4qAtr53lj7hwQEYTao7NrZKjNEV7CBSCKwWvf28ntZsMUxTw6Pqpm0gmfrsSQ=="}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:09.841034 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-debbd90c-b496-4c24-bded-7221e40cd3dc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'key_pairs'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:18:09.846177 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-debbd90c-b496-4c24-bded-7221e40cd3dc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for user 49c60c4956f8479fbfe93f9f85a8d497 and project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'key_pairs'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:18:09.918997 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-debbd90c-b496-4c24-bded-7221e40cd3dc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.595109 Jun 07 13:18:09.919599 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 13/35] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:18:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:10.132098 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1619316277", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:10.237703 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a4484067-994a-4f93-9906-e16e81b5d4aa tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a825b550>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:10.325850 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a4484067-994a-4f93-9906-e16e81b5d4aa tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 200 len: 286 microversion: 2.1 time: 0.092543 Jun 07 13:18:10.326969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 14/36] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Jun 7 13:18:10 2022] GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:10.354320 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] validate_networks() for [('f37998a8-ef40-428e-a125-520797faa6c7', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:18:10.573607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f534f421-b891-43e9-a92e-46cdaa427540 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:10.574439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f534f421-b891-43e9-a92e-46cdaa427540 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:10.597143 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f534f421-b891-43e9-a92e-46cdaa427540 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.601268 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f534f421-b891-43e9-a92e-46cdaa427540 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:10.604923 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f534f421-b891-43e9-a92e-46cdaa427540 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.609678 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f534f421-b891-43e9-a92e-46cdaa427540 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:10.766512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f534f421-b891-43e9-a92e-46cdaa427540 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:10.779486 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f534f421-b891-43e9-a92e-46cdaa427540 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1272 microversion: 2.1 time: 0.209507 Jun 07 13:18:10.780354 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 15/37] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:10 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:11.328913 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:18:11.329571 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:18:11.330188 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:18:11.330773 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:18:11.331353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:18:11.337512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a481c851-b060-4246-815d-edbc36f46131 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a825bc10>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:11.374976 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:11.375450 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:11.376249 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:11.376687 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:11.442305 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-a481c851-b060-4246-815d-edbc36f46131 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] HTTP exception thrown: Snapshot 94d2d7f9-391e-4041-b200-0ebf720c1114 could not be found. Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a481c851-b060-4246-815d-edbc36f46131 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Request method failure captured: Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 HTTP/1.1 Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1AFRqNZgr24IHdktjIpEEd-qNRLTBLbYx_pt1jgkD13V8Re8y7__7i9fG94Q2nPbARmVfa6nLWINOYznKG8n5p3tF2qziunVcNwsereZDb47uQEakhIWdZjToIEWbgHcKvQq9S3eVuULZIAT-TvVwjm6TiSttjmKHilVr6U1WomS2M Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 2b82200b81a24815acd040d2e3b1e290 Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:18:11.444876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 2b82200b81a24815acd040d2e3b1e290 Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-VolumesSnapshotsTestJSON-1577397399-project Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 20a1930545d84798b7bd7053d05ee970 Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1577397399-project Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Snapshot 94d2d7f9-391e-4041-b200-0ebf720c1114 could not be found. Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '94d2d7f9-391e-4041-b200-0ebf720c1114'} Jun 07 13:18:11.445940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 94d2d7f9-391e-4041-b200-0ebf720c1114 could not be found. (HTTP 404) (Request-ID: req-a862f521-946e-492b-ba93-c209e5dfd879) Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:11.446611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:11.447604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 94d2d7f9-391e-4041-b200-0ebf720c1114 could not be found. Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 13:18:11.448587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 94d2d7f9-391e-4041-b200-0ebf720c1114 could not be found. Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 94d2d7f9-391e-4041-b200-0ebf720c1114 could not be found. Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a481c851-b060-4246-815d-edbc36f46131 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Returning 404 to user: Snapshot 94d2d7f9-391e-4041-b200-0ebf720c1114 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:11.449506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a481c851-b060-4246-815d-edbc36f46131 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114" status: 404 len: 111 microversion: 2.1 time: 0.112752 Jun 07 13:18:11.450227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 16/38] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Jun 7 13:18:11 2022] GET /compute/v2.1/os-snapshots/94d2d7f9-391e-4041-b200-0ebf720c1114 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:18:11.455438 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-625cb08d-0fef-4c18-9a18-c49ffb39a24a tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a8271670>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:11.471844 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Getting quotas for project 7c615cd1e80a42e0ac2aff126cbb1455. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:18:11.485150 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Getting quotas for user dcf5286e9ca14f56905e6e247e411896 and project 7c615cd1e80a42e0ac2aff126cbb1455. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:18:11.506062 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:18:11.510588 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:18:11.579725 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-625cb08d-0fef-4c18-9a18-c49ffb39a24a tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828" status: 202 len: 0 microversion: 2.1 time: 0.127990 Jun 07 13:18:11.580560 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 17/39] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:18:11 2022] DELETE /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:18:11.588851 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b816a7f7-68d9-4a15-8e23-d5f352f47b2b tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a825baf0>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:11.681642 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-af3aa17e-9bcd-4a7c-897e-783e26eaebca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.678627 Jun 07 13:18:11.687183 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 23/40] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:18:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:18:11.693429 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b9844be2-fdca-4969-8a69-a83b3694c5ad tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:11.694070 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b9844be2-fdca-4969-8a69-a83b3694c5ad tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:11.842799 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b9844be2-fdca-4969-8a69-a83b3694c5ad tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:11.878394 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b9844be2-fdca-4969-8a69-a83b3694c5ad tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1222 microversion: 2.1 time: 0.183798 Jun 07 13:18:11.920562 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b816a7f7-68d9-4a15-8e23-d5f352f47b2b tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828" status: 200 len: 344 microversion: 2.1 time: 0.335546 Jun 07 13:18:11.921130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 18/41] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:11 2022] GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 => generated 344 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:11.931256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-784d3bea-9334-4b7c-86f9-00695775d907 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:11.931885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-784d3bea-9334-4b7c-86f9-00695775d907 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:11.944179 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 24/42] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:11 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:11.968050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-784d3bea-9334-4b7c-86f9-00695775d907 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:11.968616 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-784d3bea-9334-4b7c-86f9-00695775d907 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:11.969443 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-784d3bea-9334-4b7c-86f9-00695775d907 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:11.976911 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-784d3bea-9334-4b7c-86f9-00695775d907 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:12.047848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-568771616", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:12.209659 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] validate_networks() for [('f37998a8-ef40-428e-a125-520797faa6c7', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:18:12.291142 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-784d3bea-9334-4b7c-86f9-00695775d907 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:12.311996 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-784d3bea-9334-4b7c-86f9-00695775d907 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1272 microversion: 2.1 time: 0.386096 Jun 07 13:18:12.323294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 19/43] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:11 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1272 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:12.935403 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2e3b50b7-b5f8-44ac-afce-8f8f5e740221 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a825b0d0>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:12.956204 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:13.162745 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2e3b50b7-b5f8-44ac-afce-8f8f5e740221 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828" status: 200 len: 344 microversion: 2.1 time: 0.232718 Jun 07 13:18:13.163956 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 20/44] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:12 2022] GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 => generated 344 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:13.331596 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-22381bc1-5b9c-4f3f-97a7-aede5869ddae tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:13.333256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-22381bc1-5b9c-4f3f-97a7-aede5869ddae tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:13.360659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-22381bc1-5b9c-4f3f-97a7-aede5869ddae tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.364956 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-22381bc1-5b9c-4f3f-97a7-aede5869ddae tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.372270 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-22381bc1-5b9c-4f3f-97a7-aede5869ddae tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.375246 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-22381bc1-5b9c-4f3f-97a7-aede5869ddae tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.898235 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:18:13.898858 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:18:13.899396 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:18:13.900018 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:18:13.900539 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:18:13.913761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-22381bc1-5b9c-4f3f-97a7-aede5869ddae tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:13.924770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-22381bc1-5b9c-4f3f-97a7-aede5869ddae tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.597836 Jun 07 13:18:13.927526 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 21/45] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:13 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:13.931787 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.932254 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.933169 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.933715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.954485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Getting quotas for project 7c615cd1e80a42e0ac2aff126cbb1455. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:18:13.959291 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Getting quotas for user dcf5286e9ca14f56905e6e247e411896 and project 7c615cd1e80a42e0ac2aff126cbb1455. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:18:13.981492 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:18:13.984043 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:18:14.079412 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a7b8232a-d0b3-4a82-a43e-e1f847b02116 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.034723 Jun 07 13:18:14.080477 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 25/46] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:18:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:18:14.091848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ac9c3d04-088f-4078-b0cf-4b8e150ddf37 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:14.093396 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ac9c3d04-088f-4078-b0cf-4b8e150ddf37 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:14.181069 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-616c841c-2e7e-47d9-8ea7-35f9aeb27a8b tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a8a4c4c0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:14.218205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ac9c3d04-088f-4078-b0cf-4b8e150ddf37 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:14.229069 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ac9c3d04-088f-4078-b0cf-4b8e150ddf37 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1221 microversion: 2.1 time: 0.142290 Jun 07 13:18:14.232501 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 22/47] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:14 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:14.346199 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-616c841c-2e7e-47d9-8ea7-35f9aeb27a8b tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828" status: 200 len: 344 microversion: 2.1 time: 0.172411 Jun 07 13:18:14.359955 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 26/48] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:14 2022] GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:14.954227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-24ad5259-dd3f-4612-a0fd-0275f87bee45 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:14.959529 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-24ad5259-dd3f-4612-a0fd-0275f87bee45 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:14.991395 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-24ad5259-dd3f-4612-a0fd-0275f87bee45 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.992876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-24ad5259-dd3f-4612-a0fd-0275f87bee45 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.995346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-24ad5259-dd3f-4612-a0fd-0275f87bee45 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.004405 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-24ad5259-dd3f-4612-a0fd-0275f87bee45 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.250102 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-eb7dd2a6-fe50-402a-86e9-beb381658c2e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:15.251322 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-eb7dd2a6-fe50-402a-86e9-beb381658c2e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:15.264354 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-eb7dd2a6-fe50-402a-86e9-beb381658c2e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.265005 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-eb7dd2a6-fe50-402a-86e9-beb381658c2e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.266045 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-eb7dd2a6-fe50-402a-86e9-beb381658c2e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.266730 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-eb7dd2a6-fe50-402a-86e9-beb381658c2e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.436934 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-24ad5259-dd3f-4612-a0fd-0275f87bee45 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:15.457578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-24ad5259-dd3f-4612-a0fd-0275f87bee45 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.506039 Jun 07 13:18:15.459413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 23/49] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:14 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:15.470810 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-74e8eb62-205c-4fa3-8444-60a93c293c28 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a825ba60>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:15.503050 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-eb7dd2a6-fe50-402a-86e9-beb381658c2e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:15.515321 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-eb7dd2a6-fe50-402a-86e9-beb381658c2e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1225 microversion: 2.1 time: 0.269819 Jun 07 13:18:15.540114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 27/50] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:15 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1225 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:15.712821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-74e8eb62-205c-4fa3-8444-60a93c293c28 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] HTTP exception thrown: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-74e8eb62-205c-4fa3-8444-60a93c293c28 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Request method failure captured: Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 HTTP/1.1 Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1AFRqNZgr24IHdktjIpEEd-qNRLTBLbYx_pt1jgkD13V8Re8y7__7i9fG94Q2nPbARmVfa6nLWINOYznKG8n5p3tF2qziunVcNwsereZDb47uQEakhIWdZjToIEWbgHcKvQq9S3eVuULZIAT-TvVwjm6TiSttjmKHilVr6U1WomS2M Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 2b82200b81a24815acd040d2e3b1e290 Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:18:15.715474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 2b82200b81a24815acd040d2e3b1e290 Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-VolumesSnapshotsTestJSON-1577397399-project Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 20a1930545d84798b7bd7053d05ee970 Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1577397399-project Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '37d319bd-ad3d-478c-b16c-ffaadca40828'} Jun 07 13:18:15.716777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. (HTTP 404) (Request-ID: req-d469257d-144d-4666-a9f4-39caa08a1d93) Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:15.717509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:15.718793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:18:15.720219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:15.721320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:15.723393 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-74e8eb62-205c-4fa3-8444-60a93c293c28 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Returning 404 to user: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:15.725456 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-74e8eb62-205c-4fa3-8444-60a93c293c28 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828" status: 404 len: 109 microversion: 2.1 time: 0.264603 Jun 07 13:18:15.726320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 24/51] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:15 2022] GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 => generated 109 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:18:15.748819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-908357636", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7935e13c-3463-4221-bbf4-297a23e61ffb"}], "security_groups": [{"name": "tempest-securitygroup--140225368"}], "key_name": "tempest-keypair-22118456", "user_data": "}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:15.757690 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4226c0b6-752f-4172-a427-9a0310d07052 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a827bdc0>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:16.155705 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] validate_networks() for [('7935e13c-3463-4221-bbf4-297a23e61ffb', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:18:16.233093 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-4226c0b6-752f-4172-a427-9a0310d07052 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] HTTP exception thrown: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4226c0b6-752f-4172-a427-9a0310d07052 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Request method failure captured: Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: DELETE /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 HTTP/1.1 Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1AFRqNZgr24IHdktjIpEEd-qNRLTBLbYx_pt1jgkD13V8Re8y7__7i9fG94Q2nPbARmVfa6nLWINOYznKG8n5p3tF2qziunVcNwsereZDb47uQEakhIWdZjToIEWbgHcKvQq9S3eVuULZIAT-TvVwjm6TiSttjmKHilVr6U1WomS2M Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 2b82200b81a24815acd040d2e3b1e290 Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:18:16.235770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 2b82200b81a24815acd040d2e3b1e290 Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-VolumesSnapshotsTestJSON-1577397399-project Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 20a1930545d84798b7bd7053d05ee970 Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1577397399-project Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '37d319bd-ad3d-478c-b16c-ffaadca40828'} Jun 07 13:18:16.237060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. (HTTP 404) (Request-ID: req-40c4172a-890f-4f47-bb65-bc400a8ba860) Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:16.237783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:18:16.238791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 13:18:16.239940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4226c0b6-752f-4172-a427-9a0310d07052 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Returning 404 to user: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4226c0b6-752f-4172-a427-9a0310d07052 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828" status: 404 len: 109 microversion: 2.1 time: 0.491241 Jun 07 13:18:16.240954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 25/52] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:18:15 2022] DELETE /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 => generated 109 bytes in 493 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:18:16.250857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2c6a3627-5812-41b9-87e4-4f937424db91 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Calling method '.version_select at 0x7f46a825baf0>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:16.679175 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-2c6a3627-5812-41b9-87e4-4f937424db91 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] HTTP exception thrown: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2c6a3627-5812-41b9-87e4-4f937424db91 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Request method failure captured: Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 HTTP/1.1 Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1AFRqNZgr24IHdktjIpEEd-qNRLTBLbYx_pt1jgkD13V8Re8y7__7i9fG94Q2nPbARmVfa6nLWINOYznKG8n5p3tF2qziunVcNwsereZDb47uQEakhIWdZjToIEWbgHcKvQq9S3eVuULZIAT-TvVwjm6TiSttjmKHilVr6U1WomS2M Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 2b82200b81a24815acd040d2e3b1e290 Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:18:16.681358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b82200b81a24815acd040d2e3b1e290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 2b82200b81a24815acd040d2e3b1e290 Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1577397399 Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-VolumesSnapshotsTestJSON-1577397399-project Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 20a1930545d84798b7bd7053d05ee970 Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1577397399-project Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '37d319bd-ad3d-478c-b16c-ffaadca40828'} Jun 07 13:18:16.682439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. (HTTP 404) (Request-ID: req-24051572-891c-45a7-921a-fd58cd04ff58) Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:16.683360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:18:16.684285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:18:16.685206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2c6a3627-5812-41b9-87e4-4f937424db91 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] Returning 404 to user: Volume 37d319bd-ad3d-478c-b16c-ffaadca40828 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:16.686110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2c6a3627-5812-41b9-87e4-4f937424db91 tempest-VolumesSnapshotsTestJSON-1577397399 tempest-VolumesSnapshotsTestJSON-1577397399-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828" status: 404 len: 109 microversion: 2.1 time: 0.436070 Jun 07 13:18:16.686775 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 26/53] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:18:16 2022] GET /compute/v2.1/os-volumes/37d319bd-ad3d-478c-b16c-ffaadca40828 => generated 109 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:18:16.700144 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a116da32-3bd0-415d-9f1b-324c5bb8761d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:16.702687 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a116da32-3bd0-415d-9f1b-324c5bb8761d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:16.725554 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a116da32-3bd0-415d-9f1b-324c5bb8761d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.728738 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a116da32-3bd0-415d-9f1b-324c5bb8761d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.734388 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a116da32-3bd0-415d-9f1b-324c5bb8761d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.736586 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a116da32-3bd0-415d-9f1b-324c5bb8761d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:17.880651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a116da32-3bd0-415d-9f1b-324c5bb8761d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:17.898822 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a116da32-3bd0-415d-9f1b-324c5bb8761d tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 1.210607 Jun 07 13:18:17.915050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 27/54] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:16 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:17.925491 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-eabde9da-fb62-4aff-9d44-423a0d28daec tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:17.935447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-eabde9da-fb62-4aff-9d44-423a0d28daec tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:17.973343 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eabde9da-fb62-4aff-9d44-423a0d28daec tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:17.981159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eabde9da-fb62-4aff-9d44-423a0d28daec tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:17.986389 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eabde9da-fb62-4aff-9d44-423a0d28daec tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:17.991200 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eabde9da-fb62-4aff-9d44-423a0d28daec tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.071136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:18:18.071661 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:18:18.072092 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:18:18.072513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:18:18.072947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:18:18.115184 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.118757 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.122919 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.140118 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.247868 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:18:18.267455 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for user 49c60c4956f8479fbfe93f9f85a8d497 and project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:18:18.268989 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-eabde9da-fb62-4aff-9d44-423a0d28daec tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.292635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-eabde9da-fb62-4aff-9d44-423a0d28daec tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1279 microversion: 2.1 time: 0.372825 Jun 07 13:18:18.295024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 28/55] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:17 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1279 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:18.344499 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:18:18.374645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:18:18.648535 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-93065831-883b-4a07-bdc5-29ba0cb81c03 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.905667 Jun 07 13:18:18.649243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 28/56] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:18:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:18:18.660048 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3dd3836a-c3ac-49bd-b9d8-f0050bac5f8a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:18.660734 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3dd3836a-c3ac-49bd-b9d8-f0050bac5f8a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:18.932680 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9994fc18-446a-4f9f-a865-300b0de8210a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:18.933519 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9994fc18-446a-4f9f-a865-300b0de8210a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:18.950247 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9994fc18-446a-4f9f-a865-300b0de8210a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.950904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9994fc18-446a-4f9f-a865-300b0de8210a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.957080 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9994fc18-446a-4f9f-a865-300b0de8210a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.962019 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9994fc18-446a-4f9f-a865-300b0de8210a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.985256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3dd3836a-c3ac-49bd-b9d8-f0050bac5f8a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.995614 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3dd3836a-c3ac-49bd-b9d8-f0050bac5f8a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1239 microversion: 2.1 time: 0.339713 Jun 07 13:18:19.010940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 29/57] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:18 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1239 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:19.312384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-235820fa-d43e-4385-ada7-369e7c83f080 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:19.314084 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-235820fa-d43e-4385-ada7-369e7c83f080 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:19.326712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-235820fa-d43e-4385-ada7-369e7c83f080 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.331151 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-235820fa-d43e-4385-ada7-369e7c83f080 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.337470 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-235820fa-d43e-4385-ada7-369e7c83f080 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.341995 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-235820fa-d43e-4385-ada7-369e7c83f080 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.868902 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-235820fa-d43e-4385-ada7-369e7c83f080 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:19.903201 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-235820fa-d43e-4385-ada7-369e7c83f080 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1279 microversion: 2.1 time: 0.594574 Jun 07 13:18:19.915276 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 30/58] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:19 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1279 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:20.181506 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9994fc18-446a-4f9f-a865-300b0de8210a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:20.194326 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9994fc18-446a-4f9f-a865-300b0de8210a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 1.267674 Jun 07 13:18:20.198805 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 29/59] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:18 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:20.209332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-13ae17b0-6313-403a-be41-1de26be85acb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:20.209963 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-13ae17b0-6313-403a-be41-1de26be85acb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:20.225274 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-8e018013-67e8-41a9-9c9d-eccc037c2648 req-05ffa0f0-05d8-4b4e-9112-9b81148679df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83302c71-926e-4dfe-9285-936bb6f07ce8", "tag": "042bd4fd-49bb-4c75-a83c-ad7a363bf2c1"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:20.256544 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-13ae17b0-6313-403a-be41-1de26be85acb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.261554 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-13ae17b0-6313-403a-be41-1de26be85acb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.266046 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-13ae17b0-6313-403a-be41-1de26be85acb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.269565 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-13ae17b0-6313-403a-be41-1de26be85acb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.274324 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-8e018013-67e8-41a9-9c9d-eccc037c2648 req-05ffa0f0-05d8-4b4e-9112-9b81148679df service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.278371 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-8e018013-67e8-41a9-9c9d-eccc037c2648 req-05ffa0f0-05d8-4b4e-9112-9b81148679df service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.364048 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-8e018013-67e8-41a9-9c9d-eccc037c2648 req-05ffa0f0-05d8-4b4e-9112-9b81148679df service nova] Creating event network-changed:042bd4fd-49bb-4c75-a83c-ad7a363bf2c1 for instance 83302c71-926e-4dfe-9285-936bb6f07ce8 on hv-cinder-84460 Jun 07 13:18:20.367510 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-8e018013-67e8-41a9-9c9d-eccc037c2648 req-05ffa0f0-05d8-4b4e-9112-9b81148679df service nova] Acquired lock "compute-rpcapi-router" {{(pid=117843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 13:18:20.372050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-35c04709-0179-43d7-a422-042509801696 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.372737 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-35c04709-0179-43d7-a422-042509801696 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.373673 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-35c04709-0179-43d7-a422-042509801696 None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.375384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-35c04709-0179-43d7-a422-042509801696 None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.395339 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.compute.rpcapi [None req-35c04709-0179-43d7-a422-042509801696 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 13:18:20.411391 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-35c04709-0179-43d7-a422-042509801696 None None] Releasing lock "compute-rpcapi-router" {{(pid=117843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 13:18:20.471687 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-35c04709-0179-43d7-a422-042509801696 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.554969 Jun 07 13:18:20.472875 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:20.538784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-13ae17b0-6313-403a-be41-1de26be85acb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:20.553493 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-13ae17b0-6313-403a-be41-1de26be85acb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1235 microversion: 2.1 time: 0.353304 Jun 07 13:18:20.554097 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 30/61] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:20 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1235 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:20.932583 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fbd79507-c521-4123-8a95-0113827248ea tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:20.935259 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fbd79507-c521-4123-8a95-0113827248ea tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:20.963525 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fbd79507-c521-4123-8a95-0113827248ea tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.964538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fbd79507-c521-4123-8a95-0113827248ea tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.969141 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fbd79507-c521-4123-8a95-0113827248ea tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:20.970273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fbd79507-c521-4123-8a95-0113827248ea tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.128715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fbd79507-c521-4123-8a95-0113827248ea tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:21.141854 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fbd79507-c521-4123-8a95-0113827248ea tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1279 microversion: 2.1 time: 0.215768 Jun 07 13:18:21.143374 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 32/62] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:20 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1279 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:21.216698 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-321530d4-1a54-464a-a0ef-700b8bcad242 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:21.217926 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-321530d4-1a54-464a-a0ef-700b8bcad242 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:21.239715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-321530d4-1a54-464a-a0ef-700b8bcad242 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:21.240180 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-321530d4-1a54-464a-a0ef-700b8bcad242 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.240971 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-321530d4-1a54-464a-a0ef-700b8bcad242 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:21.241415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-321530d4-1a54-464a-a0ef-700b8bcad242 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.580488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-641a80c2-9d8f-4dd0-8ab7-c9b7cc5a2c20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:21.581142 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-641a80c2-9d8f-4dd0-8ab7-c9b7cc5a2c20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:21.612997 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-641a80c2-9d8f-4dd0-8ab7-c9b7cc5a2c20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:21.616602 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-641a80c2-9d8f-4dd0-8ab7-c9b7cc5a2c20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.617684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-641a80c2-9d8f-4dd0-8ab7-c9b7cc5a2c20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:21.621856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-641a80c2-9d8f-4dd0-8ab7-c9b7cc5a2c20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:21.635226 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-321530d4-1a54-464a-a0ef-700b8bcad242 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:21.648907 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-321530d4-1a54-464a-a0ef-700b8bcad242 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.434748 Jun 07 13:18:21.650537 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 31/63] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:21 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:22.159955 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-aeb11b0c-2014-4c94-953d-5caf21bf6183 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:22.162353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-aeb11b0c-2014-4c94-953d-5caf21bf6183 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:22.175231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aeb11b0c-2014-4c94-953d-5caf21bf6183 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.182268 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-641a80c2-9d8f-4dd0-8ab7-c9b7cc5a2c20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:22.183909 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aeb11b0c-2014-4c94-953d-5caf21bf6183 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:22.186661 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aeb11b0c-2014-4c94-953d-5caf21bf6183 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.190440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aeb11b0c-2014-4c94-953d-5caf21bf6183 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:22.199280 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-641a80c2-9d8f-4dd0-8ab7-c9b7cc5a2c20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1309 microversion: 2.1 time: 0.632073 Jun 07 13:18:22.199903 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 33/64] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:21 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1309 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:22.566426 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-aeb11b0c-2014-4c94-953d-5caf21bf6183 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:22.574431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-aeb11b0c-2014-4c94-953d-5caf21bf6183 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1279 microversion: 2.1 time: 0.419465 Jun 07 13:18:22.575052 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 32/65] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:22 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1279 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:22.679282 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b40c6cb2-0545-40d5-bbab-5e8e709b4c95 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:22.680959 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b40c6cb2-0545-40d5-bbab-5e8e709b4c95 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:22.708678 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b40c6cb2-0545-40d5-bbab-5e8e709b4c95 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.709159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b40c6cb2-0545-40d5-bbab-5e8e709b4c95 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:22.711809 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b40c6cb2-0545-40d5-bbab-5e8e709b4c95 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.712255 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b40c6cb2-0545-40d5-bbab-5e8e709b4c95 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:23.066793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b40c6cb2-0545-40d5-bbab-5e8e709b4c95 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:23.079488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b40c6cb2-0545-40d5-bbab-5e8e709b4c95 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.413350 Jun 07 13:18:23.080698 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 34/66] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:22 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:23.220242 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-bb13e91e-0062-44e1-9299-455a540d4bca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:23.221687 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-bb13e91e-0062-44e1-9299-455a540d4bca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:23.241589 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bb13e91e-0062-44e1-9299-455a540d4bca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:23.243100 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bb13e91e-0062-44e1-9299-455a540d4bca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:23.246660 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bb13e91e-0062-44e1-9299-455a540d4bca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:23.247166 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bb13e91e-0062-44e1-9299-455a540d4bca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:23.591930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5408d10a-f674-4469-a15c-478450d5c0cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:23.592444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5408d10a-f674-4469-a15c-478450d5c0cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:23.616949 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5408d10a-f674-4469-a15c-478450d5c0cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:23.619488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5408d10a-f674-4469-a15c-478450d5c0cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:23.620994 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5408d10a-f674-4469-a15c-478450d5c0cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:23.625554 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5408d10a-f674-4469-a15c-478450d5c0cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:23.707071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-bb13e91e-0062-44e1-9299-455a540d4bca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:23.727310 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-bb13e91e-0062-44e1-9299-455a540d4bca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1297 microversion: 2.1 time: 0.510065 Jun 07 13:18:23.737899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 33/67] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:23 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1297 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:24.097693 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-368a2edf-0995-446b-8a72-27504f5382dd tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:24.098327 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-368a2edf-0995-446b-8a72-27504f5382dd tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:24.112696 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-368a2edf-0995-446b-8a72-27504f5382dd tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:24.113773 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-368a2edf-0995-446b-8a72-27504f5382dd tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:24.117286 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-368a2edf-0995-446b-8a72-27504f5382dd tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:24.119992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-368a2edf-0995-446b-8a72-27504f5382dd tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:24.942899 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5408d10a-f674-4469-a15c-478450d5c0cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:24.954768 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5408d10a-f674-4469-a15c-478450d5c0cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 1.366615 Jun 07 13:18:24.955780 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 35/68] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:23 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:24.966096 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6e93d408-8741-4395-b5b4-bd8594c7b9a0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:24.975721 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6e93d408-8741-4395-b5b4-bd8594c7b9a0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:24.988495 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e93d408-8741-4395-b5b4-bd8594c7b9a0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:24.994076 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e93d408-8741-4395-b5b4-bd8594c7b9a0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:24.995071 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e93d408-8741-4395-b5b4-bd8594c7b9a0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:24.995526 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e93d408-8741-4395-b5b4-bd8594c7b9a0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:25.215255 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-368a2edf-0995-446b-8a72-27504f5382dd tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:25.227342 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-368a2edf-0995-446b-8a72-27504f5382dd tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 1.133686 Jun 07 13:18:25.251612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 34/69] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:24 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:25.972664 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c0d5cd94-99c7-4c1e-80bb-8ad860fd9d22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:25.973325 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c0d5cd94-99c7-4c1e-80bb-8ad860fd9d22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:25.985930 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0d5cd94-99c7-4c1e-80bb-8ad860fd9d22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:25.991613 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6e93d408-8741-4395-b5b4-bd8594c7b9a0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:25.993048 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0d5cd94-99c7-4c1e-80bb-8ad860fd9d22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:25.994038 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0d5cd94-99c7-4c1e-80bb-8ad860fd9d22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:25.994687 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0d5cd94-99c7-4c1e-80bb-8ad860fd9d22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.006788 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6e93d408-8741-4395-b5b4-bd8594c7b9a0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 1.047188 Jun 07 13:18:26.008475 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 36/70] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:24 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:26.245270 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-65761cfd-5cbb-422d-89ea-9d50d076e1e6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:26.245947 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-65761cfd-5cbb-422d-89ea-9d50d076e1e6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:26.258127 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65761cfd-5cbb-422d-89ea-9d50d076e1e6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.258612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65761cfd-5cbb-422d-89ea-9d50d076e1e6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.259427 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65761cfd-5cbb-422d-89ea-9d50d076e1e6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.260106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65761cfd-5cbb-422d-89ea-9d50d076e1e6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.595370 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c0d5cd94-99c7-4c1e-80bb-8ad860fd9d22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:26.601762 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=65 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:26.604295 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c0d5cd94-99c7-4c1e-80bb-8ad860fd9d22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.635858 Jun 07 13:18:26.606909 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 35/71] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:25 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:26.805822 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-65761cfd-5cbb-422d-89ea-9d50d076e1e6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:26.814628 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-65761cfd-5cbb-422d-89ea-9d50d076e1e6 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.573226 Jun 07 13:18:26.835149 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 37/72] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:26 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:26.894471 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-caa1ce4f-2b13-42bf-b143-0efabf163799 req-2562e7c0-c0c0-41e5-8226-bf2a50775e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bca688-1384-4f4d-a129-4129e290831c", "tag": "9fbff3a7-3340-450f-bac9-a55605b332c7"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:26.907894 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=9 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:26.910941 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-caa1ce4f-2b13-42bf-b143-0efabf163799 req-2562e7c0-c0c0-41e5-8226-bf2a50775e7b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.911641 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-caa1ce4f-2b13-42bf-b143-0efabf163799 req-2562e7c0-c0c0-41e5-8226-bf2a50775e7b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.935379 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-caa1ce4f-2b13-42bf-b143-0efabf163799 req-2562e7c0-c0c0-41e5-8226-bf2a50775e7b service nova] Creating event network-changed:9fbff3a7-3340-450f-bac9-a55605b332c7 for instance 23bca688-1384-4f4d-a129-4129e290831c on hv-cinder-84460 Jun 07 13:18:26.941189 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-caa1ce4f-2b13-42bf-b143-0efabf163799 req-2562e7c0-c0c0-41e5-8226-bf2a50775e7b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117842) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 13:18:26.943274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8165be71-226f-4b91-b449-b1a3a1c2a2da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.943936 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8165be71-226f-4b91-b449-b1a3a1c2a2da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.944949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8165be71-226f-4b91-b449-b1a3a1c2a2da None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.945587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8165be71-226f-4b91-b449-b1a3a1c2a2da None None] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.962791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.compute.rpcapi [None req-8165be71-226f-4b91-b449-b1a3a1c2a2da None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 13:18:26.963941 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8165be71-226f-4b91-b449-b1a3a1c2a2da None None] Releasing lock "compute-rpcapi-router" {{(pid=117842) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 13:18:26.993726 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8165be71-226f-4b91-b449-b1a3a1c2a2da None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105269 Jun 07 13:18:26.995018 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 36/73] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:27.025237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-20bd64a2-0a7f-4dd7-a881-54efc4409f97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:27.026621 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-20bd64a2-0a7f-4dd7-a881-54efc4409f97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:27.039773 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-20bd64a2-0a7f-4dd7-a881-54efc4409f97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.040581 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-20bd64a2-0a7f-4dd7-a881-54efc4409f97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.042256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-20bd64a2-0a7f-4dd7-a881-54efc4409f97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.044037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-20bd64a2-0a7f-4dd7-a881-54efc4409f97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.623320 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b71e1f11-9f68-4cae-b73d-cf13e60047a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:27.626788 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b71e1f11-9f68-4cae-b73d-cf13e60047a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:27.649391 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b71e1f11-9f68-4cae-b73d-cf13e60047a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.650432 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b71e1f11-9f68-4cae-b73d-cf13e60047a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.652431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b71e1f11-9f68-4cae-b73d-cf13e60047a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.653064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b71e1f11-9f68-4cae-b73d-cf13e60047a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.865748 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-20bd64a2-0a7f-4dd7-a881-54efc4409f97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:27.876152 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=95 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:27.879345 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-20bd64a2-0a7f-4dd7-a881-54efc4409f97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.858593 Jun 07 13:18:27.880986 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 38/74] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:27 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:27.888724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-57f9a6d2-2ea6-4256-a0a3-1aecffdff336 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:27.890734 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-57f9a6d2-2ea6-4256-a0a3-1aecffdff336 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:27.902716 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:27.905002 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-57f9a6d2-2ea6-4256-a0a3-1aecffdff336 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.905757 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-57f9a6d2-2ea6-4256-a0a3-1aecffdff336 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.907031 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-57f9a6d2-2ea6-4256-a0a3-1aecffdff336 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.907574 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-57f9a6d2-2ea6-4256-a0a3-1aecffdff336 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.072889 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b71e1f11-9f68-4cae-b73d-cf13e60047a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:28.081932 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b71e1f11-9f68-4cae-b73d-cf13e60047a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.464209 Jun 07 13:18:28.083014 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 37/75] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:27 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:28.342673 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-57f9a6d2-2ea6-4256-a0a3-1aecffdff336 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:28.359346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-57f9a6d2-2ea6-4256-a0a3-1aecffdff336 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.476992 Jun 07 13:18:28.360244 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 39/76] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:27 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:28.898770 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-daab8503-9390-461b-83af-a2a56487241c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:28.900282 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-daab8503-9390-461b-83af-a2a56487241c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:28.914510 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=22 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:28.917551 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-daab8503-9390-461b-83af-a2a56487241c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.917913 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-daab8503-9390-461b-83af-a2a56487241c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.918707 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-daab8503-9390-461b-83af-a2a56487241c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.919180 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-daab8503-9390-461b-83af-a2a56487241c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.013464 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-e1825a2d-97fd-4f4b-b214-96010aa73644 req-02235455-9915-4daa-9c85-cece64f42757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5b3667-5810-4568-976f-ca312dc065f4", "tag": "853e6961-92a5-492c-a8b3-2379de8141ed"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:29.047411 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=16 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:29.055441 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-e1825a2d-97fd-4f4b-b214-96010aa73644 req-02235455-9915-4daa-9c85-cece64f42757 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.057328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-e1825a2d-97fd-4f4b-b214-96010aa73644 req-02235455-9915-4daa-9c85-cece64f42757 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.083041 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-e1825a2d-97fd-4f4b-b214-96010aa73644 req-02235455-9915-4daa-9c85-cece64f42757 service nova] Creating event network-changed:853e6961-92a5-492c-a8b3-2379de8141ed for instance ba5b3667-5810-4568-976f-ca312dc065f4 on hv-cinder-84460 Jun 07 13:18:29.092894 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-e1825a2d-97fd-4f4b-b214-96010aa73644 req-02235455-9915-4daa-9c85-cece64f42757 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083917 Jun 07 13:18:29.094451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 40/77] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:29.323550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-daab8503-9390-461b-83af-a2a56487241c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:29.335778 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-402a237a-5c37-4735-9395-e6479c519810 req-cc9d5c77-33ae-49d8-99c2-b1acbbef2773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1184d0bc-4e76-42ed-8a67-6df8ce452b2e", "tag": "e938804d-36ef-4d7d-8a4a-5644b1bcebff"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:29.347407 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-daab8503-9390-461b-83af-a2a56487241c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.453543 Jun 07 13:18:29.355395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 38/78] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:28 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:29.358911 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-402a237a-5c37-4735-9395-e6479c519810 req-cc9d5c77-33ae-49d8-99c2-b1acbbef2773 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.359385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-402a237a-5c37-4735-9395-e6479c519810 req-cc9d5c77-33ae-49d8-99c2-b1acbbef2773 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.362108 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8304e19a-e8d1-4176-be67-790f15b7f623 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:29.363004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8304e19a-e8d1-4176-be67-790f15b7f623 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:29.370850 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8304e19a-e8d1-4176-be67-790f15b7f623 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.371726 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8304e19a-e8d1-4176-be67-790f15b7f623 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.372771 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8304e19a-e8d1-4176-be67-790f15b7f623 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.373392 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8304e19a-e8d1-4176-be67-790f15b7f623 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.400843 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-402a237a-5c37-4735-9395-e6479c519810 req-cc9d5c77-33ae-49d8-99c2-b1acbbef2773 service nova] Creating event network-changed:e938804d-36ef-4d7d-8a4a-5644b1bcebff for instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e on hv-cinder-84460 Jun 07 13:18:29.409059 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-402a237a-5c37-4735-9395-e6479c519810 req-cc9d5c77-33ae-49d8-99c2-b1acbbef2773 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312593 Jun 07 13:18:29.415421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 41/79] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:29.423480 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f3e825b7-1811-41fd-a5c1-70c04645b56c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:29.424488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f3e825b7-1811-41fd-a5c1-70c04645b56c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:29.438041 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f3e825b7-1811-41fd-a5c1-70c04645b56c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.438789 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f3e825b7-1811-41fd-a5c1-70c04645b56c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.439950 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f3e825b7-1811-41fd-a5c1-70c04645b56c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.440638 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f3e825b7-1811-41fd-a5c1-70c04645b56c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.636787 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8304e19a-e8d1-4176-be67-790f15b7f623 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:29.648696 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8304e19a-e8d1-4176-be67-790f15b7f623 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.291833 Jun 07 13:18:29.649906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 39/80] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:29 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:29.683629 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f3e825b7-1811-41fd-a5c1-70c04645b56c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:29.698859 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f3e825b7-1811-41fd-a5c1-70c04645b56c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.280277 Jun 07 13:18:29.699636 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 42/81] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:29 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:30.367796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1d1f1cfd-295b-4c34-84e5-ee9cad0b492c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:30.369595 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1d1f1cfd-295b-4c34-84e5-ee9cad0b492c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:30.376732 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1d1f1cfd-295b-4c34-84e5-ee9cad0b492c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.377468 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1d1f1cfd-295b-4c34-84e5-ee9cad0b492c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.379491 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1d1f1cfd-295b-4c34-84e5-ee9cad0b492c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.380287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1d1f1cfd-295b-4c34-84e5-ee9cad0b492c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.566221 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1d1f1cfd-295b-4c34-84e5-ee9cad0b492c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:30.576421 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1d1f1cfd-295b-4c34-84e5-ee9cad0b492c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.213141 Jun 07 13:18:30.577429 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 40/82] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:30 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:30.666806 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4de01fd2-5563-4c21-9945-057300afe049 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:30.667614 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4de01fd2-5563-4c21-9945-057300afe049 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:30.673981 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:30.675942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4de01fd2-5563-4c21-9945-057300afe049 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.676692 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4de01fd2-5563-4c21-9945-057300afe049 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.677711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4de01fd2-5563-4c21-9945-057300afe049 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.678373 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4de01fd2-5563-4c21-9945-057300afe049 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.721902 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-288aa471-00fc-47f4-8974-d092f12dcedf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:30.723995 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-288aa471-00fc-47f4-8974-d092f12dcedf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:30.744555 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-288aa471-00fc-47f4-8974-d092f12dcedf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.745258 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-288aa471-00fc-47f4-8974-d092f12dcedf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.748415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-288aa471-00fc-47f4-8974-d092f12dcedf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.754391 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-288aa471-00fc-47f4-8974-d092f12dcedf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.902594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4de01fd2-5563-4c21-9945-057300afe049 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:30.918245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4de01fd2-5563-4c21-9945-057300afe049 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.255889 Jun 07 13:18:30.919913 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 43/83] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:30 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:31.065127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-288aa471-00fc-47f4-8974-d092f12dcedf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:31.074428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-288aa471-00fc-47f4-8974-d092f12dcedf tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.356509 Jun 07 13:18:31.075126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 41/84] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:30 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:31.593572 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3a1799d9-0b95-4b37-a0ee-34d278638532 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:31.594196 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3a1799d9-0b95-4b37-a0ee-34d278638532 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:31.600982 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3a1799d9-0b95-4b37-a0ee-34d278638532 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.601434 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3a1799d9-0b95-4b37-a0ee-34d278638532 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.602197 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3a1799d9-0b95-4b37-a0ee-34d278638532 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.602632 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3a1799d9-0b95-4b37-a0ee-34d278638532 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.748281 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3a1799d9-0b95-4b37-a0ee-34d278638532 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:31.762127 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3a1799d9-0b95-4b37-a0ee-34d278638532 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.172441 Jun 07 13:18:31.767522 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 44/85] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:31 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:31.937783 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c4ab69e5-c7f9-47a4-95fa-f34cfec6910c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:31.939140 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c4ab69e5-c7f9-47a4-95fa-f34cfec6910c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:31.947872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4ab69e5-c7f9-47a4-95fa-f34cfec6910c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.948548 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4ab69e5-c7f9-47a4-95fa-f34cfec6910c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.949573 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4ab69e5-c7f9-47a4-95fa-f34cfec6910c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.950248 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4ab69e5-c7f9-47a4-95fa-f34cfec6910c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.095020 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-db73d20e-b525-4962-b699-048737f8437c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:32.096066 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-db73d20e-b525-4962-b699-048737f8437c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:32.102965 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-db73d20e-b525-4962-b699-048737f8437c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.103420 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-db73d20e-b525-4962-b699-048737f8437c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.104195 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-db73d20e-b525-4962-b699-048737f8437c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.104625 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-db73d20e-b525-4962-b699-048737f8437c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.320005 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c4ab69e5-c7f9-47a4-95fa-f34cfec6910c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:32.327663 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c4ab69e5-c7f9-47a4-95fa-f34cfec6910c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.396362 Jun 07 13:18:32.330619 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 42/86] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:31 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:32.403805 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-db73d20e-b525-4962-b699-048737f8437c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:32.425581 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-db73d20e-b525-4962-b699-048737f8437c tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.325818 Jun 07 13:18:32.433822 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 45/87] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:32 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:32.786244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7f259959-2ece-4fe7-9a6a-3281d1a7d845 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:32.788078 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-7f259959-2ece-4fe7-9a6a-3281d1a7d845 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:32.796672 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7f259959-2ece-4fe7-9a6a-3281d1a7d845 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.797384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7f259959-2ece-4fe7-9a6a-3281d1a7d845 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.798398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7f259959-2ece-4fe7-9a6a-3281d1a7d845 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.799171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7f259959-2ece-4fe7-9a6a-3281d1a7d845 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.016932 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7f259959-2ece-4fe7-9a6a-3281d1a7d845 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:33.025196 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7f259959-2ece-4fe7-9a6a-3281d1a7d845 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.245896 Jun 07 13:18:33.035189 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 43/88] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:32 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:33.349045 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-75253e73-0468-4295-bd5a-6f747eb8e88b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:33.359497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-75253e73-0468-4295-bd5a-6f747eb8e88b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:33.370018 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-75253e73-0468-4295-bd5a-6f747eb8e88b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.370388 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-75253e73-0468-4295-bd5a-6f747eb8e88b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.371249 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-75253e73-0468-4295-bd5a-6f747eb8e88b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.371684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-75253e73-0468-4295-bd5a-6f747eb8e88b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.556532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-71ab54f1-1208-466b-a18e-4fd5516379f2 req-cb24e299-de87-4e95-8dcb-5f6cbfaa82be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83302c71-926e-4dfe-9285-936bb6f07ce8", "name": "network-vif-plugged", "status": "completed", "tag": "042bd4fd-49bb-4c75-a83c-ad7a363bf2c1"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:33.566756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-71ab54f1-1208-466b-a18e-4fd5516379f2 req-cb24e299-de87-4e95-8dcb-5f6cbfaa82be service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.568073 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-71ab54f1-1208-466b-a18e-4fd5516379f2 req-cb24e299-de87-4e95-8dcb-5f6cbfaa82be service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.586106 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-71ab54f1-1208-466b-a18e-4fd5516379f2 req-cb24e299-de87-4e95-8dcb-5f6cbfaa82be service nova] Creating event network-vif-plugged:042bd4fd-49bb-4c75-a83c-ad7a363bf2c1 for instance 83302c71-926e-4dfe-9285-936bb6f07ce8 on hv-cinder-84460 Jun 07 13:18:33.592915 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-71ab54f1-1208-466b-a18e-4fd5516379f2 req-cb24e299-de87-4e95-8dcb-5f6cbfaa82be service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240874 Jun 07 13:18:33.599790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 44/89] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:33.608283 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8417a985-a43e-4204-9768-014241996d65 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:33.610013 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8417a985-a43e-4204-9768-014241996d65 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:33.611558 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-75253e73-0468-4295-bd5a-6f747eb8e88b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:33.620994 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-75253e73-0468-4295-bd5a-6f747eb8e88b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.279166 Jun 07 13:18:33.621835 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8417a985-a43e-4204-9768-014241996d65 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.622147 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 46/90] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:33 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:33.622903 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8417a985-a43e-4204-9768-014241996d65 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.624220 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8417a985-a43e-4204-9768-014241996d65 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.624845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8417a985-a43e-4204-9768-014241996d65 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.795427 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8417a985-a43e-4204-9768-014241996d65 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:33.804979 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8417a985-a43e-4204-9768-014241996d65 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.202904 Jun 07 13:18:33.808629 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 45/91] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:33 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:34.042812 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b5010f66-df33-4643-8529-095a6def195b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:34.043595 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b5010f66-df33-4643-8529-095a6def195b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:34.050079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5010f66-df33-4643-8529-095a6def195b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.050530 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5010f66-df33-4643-8529-095a6def195b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.051594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5010f66-df33-4643-8529-095a6def195b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.052673 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5010f66-df33-4643-8529-095a6def195b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.226920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b5010f66-df33-4643-8529-095a6def195b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.236316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b5010f66-df33-4643-8529-095a6def195b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.197245 Jun 07 13:18:34.236994 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 47/92] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:34 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:34.640625 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-45fc80a1-d230-4ba8-905b-d6b8227e7e48 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:34.641248 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-45fc80a1-d230-4ba8-905b-d6b8227e7e48 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:34.648872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-45fc80a1-d230-4ba8-905b-d6b8227e7e48 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.649332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-45fc80a1-d230-4ba8-905b-d6b8227e7e48 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.650304 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-45fc80a1-d230-4ba8-905b-d6b8227e7e48 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.650746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-45fc80a1-d230-4ba8-905b-d6b8227e7e48 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.795310 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-45fc80a1-d230-4ba8-905b-d6b8227e7e48 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.804184 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-45fc80a1-d230-4ba8-905b-d6b8227e7e48 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.167254 Jun 07 13:18:34.813829 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 46/93] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:34 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:34.824398 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0ed12e49-5780-40e9-9b88-7fc961adf721 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:34.825001 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0ed12e49-5780-40e9-9b88-7fc961adf721 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:34.834328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0ed12e49-5780-40e9-9b88-7fc961adf721 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.835011 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0ed12e49-5780-40e9-9b88-7fc961adf721 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.836083 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0ed12e49-5780-40e9-9b88-7fc961adf721 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.836528 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0ed12e49-5780-40e9-9b88-7fc961adf721 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.985412 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0ed12e49-5780-40e9-9b88-7fc961adf721 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.995514 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0ed12e49-5780-40e9-9b88-7fc961adf721 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.174750 Jun 07 13:18:34.999688 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 48/94] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:34 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:35.255507 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0ad73ebc-01d2-4563-9b00-d48c5205daab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:35.256191 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0ad73ebc-01d2-4563-9b00-d48c5205daab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:35.271532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ad73ebc-01d2-4563-9b00-d48c5205daab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:35.272099 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ad73ebc-01d2-4563-9b00-d48c5205daab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:35.272758 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ad73ebc-01d2-4563-9b00-d48c5205daab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:35.273205 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ad73ebc-01d2-4563-9b00-d48c5205daab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:35.426877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0ad73ebc-01d2-4563-9b00-d48c5205daab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:35.438756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0ad73ebc-01d2-4563-9b00-d48c5205daab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.188850 Jun 07 13:18:35.439985 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 47/95] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:35 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:35.822593 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ef03e707-db28-4cd5-8a3f-029898ddbf09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:35.823246 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ef03e707-db28-4cd5-8a3f-029898ddbf09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:35.829776 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ef03e707-db28-4cd5-8a3f-029898ddbf09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:35.830325 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ef03e707-db28-4cd5-8a3f-029898ddbf09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:35.831191 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ef03e707-db28-4cd5-8a3f-029898ddbf09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:35.831622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ef03e707-db28-4cd5-8a3f-029898ddbf09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:35.980258 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ef03e707-db28-4cd5-8a3f-029898ddbf09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:35.992024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ef03e707-db28-4cd5-8a3f-029898ddbf09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.174751 Jun 07 13:18:35.992818 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 49/96] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:35 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:36.013265 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-37079740-d4bc-4b93-8448-fe6fac4882f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:36.013882 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-37079740-d4bc-4b93-8448-fe6fac4882f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:36.021285 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-37079740-d4bc-4b93-8448-fe6fac4882f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.021761 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-37079740-d4bc-4b93-8448-fe6fac4882f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.025584 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-37079740-d4bc-4b93-8448-fe6fac4882f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.025584 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-37079740-d4bc-4b93-8448-fe6fac4882f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.183011 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-37079740-d4bc-4b93-8448-fe6fac4882f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:36.190996 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-37079740-d4bc-4b93-8448-fe6fac4882f0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.181439 Jun 07 13:18:36.191564 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 48/97] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:36 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:36.457412 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ec760075-13b4-4034-8d97-14c885a0725b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:36.458689 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ec760075-13b4-4034-8d97-14c885a0725b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:36.465330 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ec760075-13b4-4034-8d97-14c885a0725b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.465927 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ec760075-13b4-4034-8d97-14c885a0725b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.466847 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ec760075-13b4-4034-8d97-14c885a0725b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.467477 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ec760075-13b4-4034-8d97-14c885a0725b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.614230 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ec760075-13b4-4034-8d97-14c885a0725b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:36.622492 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ec760075-13b4-4034-8d97-14c885a0725b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.169191 Jun 07 13:18:36.629228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 50/98] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:36 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:37.011225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-39306644-2ccf-465a-83e7-f5e4841dfa7b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:37.012166 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-39306644-2ccf-465a-83e7-f5e4841dfa7b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:37.019058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=8 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:37.021793 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-39306644-2ccf-465a-83e7-f5e4841dfa7b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.022449 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-39306644-2ccf-465a-83e7-f5e4841dfa7b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.023315 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-39306644-2ccf-465a-83e7-f5e4841dfa7b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.023902 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-39306644-2ccf-465a-83e7-f5e4841dfa7b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.171185 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-39306644-2ccf-465a-83e7-f5e4841dfa7b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:37.179289 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-39306644-2ccf-465a-83e7-f5e4841dfa7b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.173024 Jun 07 13:18:37.179942 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 49/99] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:37 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:37.208874 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1c60d83c-0e10-4e2d-b071-ef598048b3de tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:37.209564 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1c60d83c-0e10-4e2d-b071-ef598048b3de tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:37.216105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1c60d83c-0e10-4e2d-b071-ef598048b3de tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.216558 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1c60d83c-0e10-4e2d-b071-ef598048b3de tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.217415 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1c60d83c-0e10-4e2d-b071-ef598048b3de tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.217894 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1c60d83c-0e10-4e2d-b071-ef598048b3de tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.356016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1c60d83c-0e10-4e2d-b071-ef598048b3de tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:37.370992 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1c60d83c-0e10-4e2d-b071-ef598048b3de tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.167135 Jun 07 13:18:37.371577 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 51/100] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:37 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:37.644446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8912e932-aa9d-4322-bd90-f40b94d66a13 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:37.645058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8912e932-aa9d-4322-bd90-f40b94d66a13 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:37.651273 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8912e932-aa9d-4322-bd90-f40b94d66a13 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.651727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8912e932-aa9d-4322-bd90-f40b94d66a13 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.652485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8912e932-aa9d-4322-bd90-f40b94d66a13 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.652922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8912e932-aa9d-4322-bd90-f40b94d66a13 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.794727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8912e932-aa9d-4322-bd90-f40b94d66a13 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:37.803195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8912e932-aa9d-4322-bd90-f40b94d66a13 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.162205 Jun 07 13:18:37.803898 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 50/101] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:37 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:38.195433 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a7897ad3-9ddc-4843-b726-87253cd769ca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:38.196245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a7897ad3-9ddc-4843-b726-87253cd769ca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:38.203029 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a7897ad3-9ddc-4843-b726-87253cd769ca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:38.203553 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a7897ad3-9ddc-4843-b726-87253cd769ca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:38.204389 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a7897ad3-9ddc-4843-b726-87253cd769ca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:38.205179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a7897ad3-9ddc-4843-b726-87253cd769ca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:38.335302 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a7897ad3-9ddc-4843-b726-87253cd769ca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:38.342591 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a7897ad3-9ddc-4843-b726-87253cd769ca tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.151037 Jun 07 13:18:38.343256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 52/102] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:38 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:38.388449 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-51152ab1-ecd2-4d57-b67c-e8052ffd491a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:38.389080 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-51152ab1-ecd2-4d57-b67c-e8052ffd491a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:38.396046 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-51152ab1-ecd2-4d57-b67c-e8052ffd491a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:38.396567 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-51152ab1-ecd2-4d57-b67c-e8052ffd491a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:38.397417 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-51152ab1-ecd2-4d57-b67c-e8052ffd491a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:38.397918 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-51152ab1-ecd2-4d57-b67c-e8052ffd491a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:38.534114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-51152ab1-ecd2-4d57-b67c-e8052ffd491a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:38.541704 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-51152ab1-ecd2-4d57-b67c-e8052ffd491a tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.157089 Jun 07 13:18:38.542276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 51/103] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:38 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:38.820810 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c5ccf951-91cf-4ca4-97d9-f1bb3b37a745 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:38.821588 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c5ccf951-91cf-4ca4-97d9-f1bb3b37a745 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:38.828421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5ccf951-91cf-4ca4-97d9-f1bb3b37a745 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:38.828879 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5ccf951-91cf-4ca4-97d9-f1bb3b37a745 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:38.829653 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5ccf951-91cf-4ca4-97d9-f1bb3b37a745 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:38.830095 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5ccf951-91cf-4ca4-97d9-f1bb3b37a745 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:38.967815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c5ccf951-91cf-4ca4-97d9-f1bb3b37a745 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:38.975535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c5ccf951-91cf-4ca4-97d9-f1bb3b37a745 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.159397 Jun 07 13:18:38.976103 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 53/104] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:38 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:39.361294 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9174d89c-ddfb-4143-8b9b-9b37288f593f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:39.362085 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9174d89c-ddfb-4143-8b9b-9b37288f593f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:39.375627 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9174d89c-ddfb-4143-8b9b-9b37288f593f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:39.376339 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9174d89c-ddfb-4143-8b9b-9b37288f593f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:39.377538 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9174d89c-ddfb-4143-8b9b-9b37288f593f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:39.379243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9174d89c-ddfb-4143-8b9b-9b37288f593f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:39.561721 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7934d1ee-ff31-4e2c-86ae-e6cb04bea4e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:39.562725 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7934d1ee-ff31-4e2c-86ae-e6cb04bea4e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:39.582753 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7934d1ee-ff31-4e2c-86ae-e6cb04bea4e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:39.584100 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7934d1ee-ff31-4e2c-86ae-e6cb04bea4e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:39.586383 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7934d1ee-ff31-4e2c-86ae-e6cb04bea4e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:39.587648 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7934d1ee-ff31-4e2c-86ae-e6cb04bea4e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:39.906770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7934d1ee-ff31-4e2c-86ae-e6cb04bea4e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:39.917693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7934d1ee-ff31-4e2c-86ae-e6cb04bea4e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.362451 Jun 07 13:18:39.918306 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 54/105] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:39 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:39.929040 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9174d89c-ddfb-4143-8b9b-9b37288f593f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:39.939644 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9174d89c-ddfb-4143-8b9b-9b37288f593f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.582878 Jun 07 13:18:39.940750 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 52/106] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:39 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:39.993227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c7ef80ec-ae42-4dfe-82d8-10afb7641d20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:39.993857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c7ef80ec-ae42-4dfe-82d8-10afb7641d20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:40.002485 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c7ef80ec-ae42-4dfe-82d8-10afb7641d20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.002961 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c7ef80ec-ae42-4dfe-82d8-10afb7641d20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.004418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c7ef80ec-ae42-4dfe-82d8-10afb7641d20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.004915 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c7ef80ec-ae42-4dfe-82d8-10afb7641d20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.198945 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c7ef80ec-ae42-4dfe-82d8-10afb7641d20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:40.210726 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c7ef80ec-ae42-4dfe-82d8-10afb7641d20 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.222539 Jun 07 13:18:40.213029 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 55/107] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:39 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:40.934100 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a7ba6625-2756-4dd3-997d-e830fb9dfff3 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:40.934854 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a7ba6625-2756-4dd3-997d-e830fb9dfff3 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:40.941138 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7ba6625-2756-4dd3-997d-e830fb9dfff3 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.941782 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7ba6625-2756-4dd3-997d-e830fb9dfff3 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.943133 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7ba6625-2756-4dd3-997d-e830fb9dfff3 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.943717 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7ba6625-2756-4dd3-997d-e830fb9dfff3 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.958960 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=100 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:40.960245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2fa1e9fa-5c12-4826-9773-4acfa3f2e5a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:40.961068 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2fa1e9fa-5c12-4826-9773-4acfa3f2e5a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:40.972859 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2fa1e9fa-5c12-4826-9773-4acfa3f2e5a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.974026 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2fa1e9fa-5c12-4826-9773-4acfa3f2e5a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.975029 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2fa1e9fa-5c12-4826-9773-4acfa3f2e5a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.975631 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2fa1e9fa-5c12-4826-9773-4acfa3f2e5a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:41.148746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a7ba6625-2756-4dd3-997d-e830fb9dfff3 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:41.158721 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a7ba6625-2756-4dd3-997d-e830fb9dfff3 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.228214 Jun 07 13:18:41.163176 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 53/108] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:40 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:41.207529 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2fa1e9fa-5c12-4826-9773-4acfa3f2e5a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:41.210641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=100 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:41.222581 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2fa1e9fa-5c12-4826-9773-4acfa3f2e5a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.268334 Jun 07 13:18:41.225614 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 56/109] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:40 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:41.240232 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fd79510c-5ba7-40f1-905d-3939d85ea415 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:41.241073 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fd79510c-5ba7-40f1-905d-3939d85ea415 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:41.249902 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fd79510c-5ba7-40f1-905d-3939d85ea415 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:41.250359 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fd79510c-5ba7-40f1-905d-3939d85ea415 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:41.251213 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fd79510c-5ba7-40f1-905d-3939d85ea415 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:41.251652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fd79510c-5ba7-40f1-905d-3939d85ea415 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:41.383035 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-81dfdf43-f54d-4d82-912c-fde81daeecc1 req-31dc12c2-6729-4090-9750-5d192704954b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5b3667-5810-4568-976f-ca312dc065f4", "name": "network-vif-plugged", "status": "completed", "tag": "853e6961-92a5-492c-a8b3-2379de8141ed"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:41.401387 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-81dfdf43-f54d-4d82-912c-fde81daeecc1 req-31dc12c2-6729-4090-9750-5d192704954b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:41.401837 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-81dfdf43-f54d-4d82-912c-fde81daeecc1 req-31dc12c2-6729-4090-9750-5d192704954b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:41.432857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-81dfdf43-f54d-4d82-912c-fde81daeecc1 req-31dc12c2-6729-4090-9750-5d192704954b service nova] Creating event network-vif-plugged:853e6961-92a5-492c-a8b3-2379de8141ed for instance ba5b3667-5810-4568-976f-ca312dc065f4 on hv-cinder-84460 Jun 07 13:18:41.441375 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-81dfdf43-f54d-4d82-912c-fde81daeecc1 req-31dc12c2-6729-4090-9750-5d192704954b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062941 Jun 07 13:18:41.441993 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 57/110] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:18:41.528074 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fd79510c-5ba7-40f1-905d-3939d85ea415 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:41.541780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fd79510c-5ba7-40f1-905d-3939d85ea415 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.305913 Jun 07 13:18:41.542584 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 54/111] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:41 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:42.184379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-19b47394-4e1f-4b88-8dfa-49552313c81f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:42.187008 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-19b47394-4e1f-4b88-8dfa-49552313c81f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:42.197929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-19b47394-4e1f-4b88-8dfa-49552313c81f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.198969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-19b47394-4e1f-4b88-8dfa-49552313c81f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.200156 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-19b47394-4e1f-4b88-8dfa-49552313c81f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.200705 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-19b47394-4e1f-4b88-8dfa-49552313c81f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.241502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2283922a-71f7-4319-81ac-ed6899e3b641 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:42.242115 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2283922a-71f7-4319-81ac-ed6899e3b641 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:42.250020 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2283922a-71f7-4319-81ac-ed6899e3b641 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.254414 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2283922a-71f7-4319-81ac-ed6899e3b641 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.255905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2283922a-71f7-4319-81ac-ed6899e3b641 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.256342 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2283922a-71f7-4319-81ac-ed6899e3b641 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.613019 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-19b47394-4e1f-4b88-8dfa-49552313c81f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:42.619277 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-19b47394-4e1f-4b88-8dfa-49552313c81f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1314 microversion: 2.1 time: 0.443680 Jun 07 13:18:42.629037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 58/112] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:42 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:42.635679 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c41ed64a-3d3f-468b-b61b-a588fcd637f8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:42.636457 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c41ed64a-3d3f-468b-b61b-a588fcd637f8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:42.644156 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c41ed64a-3d3f-468b-b61b-a588fcd637f8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.644698 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c41ed64a-3d3f-468b-b61b-a588fcd637f8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.645582 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c41ed64a-3d3f-468b-b61b-a588fcd637f8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.646108 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c41ed64a-3d3f-468b-b61b-a588fcd637f8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.652752 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2283922a-71f7-4319-81ac-ed6899e3b641 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:42.660958 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2283922a-71f7-4319-81ac-ed6899e3b641 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.423172 Jun 07 13:18:42.671194 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 55/113] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:42 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:42.945967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c41ed64a-3d3f-468b-b61b-a588fcd637f8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:42.958360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c41ed64a-3d3f-468b-b61b-a588fcd637f8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.326517 Jun 07 13:18:42.958964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 59/114] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:42 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:43.469665 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-96103330-f35c-4fb3-80ec-cedfe3aae032 req-c62dd075-5922-4d86-84f4-fe9de40860bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1184d0bc-4e76-42ed-8a67-6df8ce452b2e", "name": "network-vif-plugged", "status": "completed", "tag": "e938804d-36ef-4d7d-8a4a-5644b1bcebff"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:43.483905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-96103330-f35c-4fb3-80ec-cedfe3aae032 req-c62dd075-5922-4d86-84f4-fe9de40860bd service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.485062 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-96103330-f35c-4fb3-80ec-cedfe3aae032 req-c62dd075-5922-4d86-84f4-fe9de40860bd service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.505991 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-96103330-f35c-4fb3-80ec-cedfe3aae032 req-c62dd075-5922-4d86-84f4-fe9de40860bd service nova] Creating event network-vif-plugged:e938804d-36ef-4d7d-8a4a-5644b1bcebff for instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e on hv-cinder-84460 Jun 07 13:18:43.516438 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-96103330-f35c-4fb3-80ec-cedfe3aae032 req-c62dd075-5922-4d86-84f4-fe9de40860bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051262 Jun 07 13:18:43.517210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 56/115] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:43.636826 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-53c5920a-79a3-4ae6-86f8-4d0091aac33e tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:43.637513 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-53c5920a-79a3-4ae6-86f8-4d0091aac33e tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:43.645517 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-53c5920a-79a3-4ae6-86f8-4d0091aac33e tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.647808 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-53c5920a-79a3-4ae6-86f8-4d0091aac33e tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.648626 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-53c5920a-79a3-4ae6-86f8-4d0091aac33e tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.649062 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-53c5920a-79a3-4ae6-86f8-4d0091aac33e tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.678929 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ad46cfe3-161f-4e66-8019-7751c8f13679 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:43.679794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ad46cfe3-161f-4e66-8019-7751c8f13679 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:43.692755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ad46cfe3-161f-4e66-8019-7751c8f13679 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.694183 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ad46cfe3-161f-4e66-8019-7751c8f13679 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.699499 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ad46cfe3-161f-4e66-8019-7751c8f13679 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.700349 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ad46cfe3-161f-4e66-8019-7751c8f13679 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.948987 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-53c5920a-79a3-4ae6-86f8-4d0091aac33e tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:43.959919 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-53c5920a-79a3-4ae6-86f8-4d0091aac33e tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1501 microversion: 2.1 time: 0.328168 Jun 07 13:18:43.961392 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 60/116] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:43 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1501 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:43.977745 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8f187db4-bbf3-4d93-80a6-530f4ff179fe tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:43.978539 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8f187db4-bbf3-4d93-80a6-530f4ff179fe tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:43.985914 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f187db4-bbf3-4d93-80a6-530f4ff179fe tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.987322 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f187db4-bbf3-4d93-80a6-530f4ff179fe tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.988364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f187db4-bbf3-4d93-80a6-530f4ff179fe tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.988887 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f187db4-bbf3-4d93-80a6-530f4ff179fe tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.021093 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ad46cfe3-161f-4e66-8019-7751c8f13679 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:44.030423 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ad46cfe3-161f-4e66-8019-7751c8f13679 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1321 microversion: 2.1 time: 0.356552 Jun 07 13:18:44.032622 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 57/117] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:43 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:44.177554 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8f187db4-bbf3-4d93-80a6-530f4ff179fe tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:44.186599 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8f187db4-bbf3-4d93-80a6-530f4ff179fe tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.215023 Jun 07 13:18:44.187521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 61/118] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:43 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:45.052272 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4a959cec-9c88-4ea5-b23a-d5922847b86c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:45.054217 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4a959cec-9c88-4ea5-b23a-d5922847b86c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:45.063586 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4a959cec-9c88-4ea5-b23a-d5922847b86c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.064299 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4a959cec-9c88-4ea5-b23a-d5922847b86c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.065274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4a959cec-9c88-4ea5-b23a-d5922847b86c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.066021 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4a959cec-9c88-4ea5-b23a-d5922847b86c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.205968 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d160417f-018c-4c22-89c9-a3290174e59a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:45.206709 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d160417f-018c-4c22-89c9-a3290174e59a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:45.219684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d160417f-018c-4c22-89c9-a3290174e59a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.221444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d160417f-018c-4c22-89c9-a3290174e59a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.222413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d160417f-018c-4c22-89c9-a3290174e59a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.226718 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d160417f-018c-4c22-89c9-a3290174e59a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.406220 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4a959cec-9c88-4ea5-b23a-d5922847b86c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:45.420012 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4a959cec-9c88-4ea5-b23a-d5922847b86c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1515 microversion: 2.1 time: 0.373351 Jun 07 13:18:45.420629 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 58/119] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:45 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1515 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:45.448216 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-32724465-d79c-43d3-8822-addf6a3643d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:45.449260 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-32724465-d79c-43d3-8822-addf6a3643d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:45.462556 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-32724465-d79c-43d3-8822-addf6a3643d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.463074 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-32724465-d79c-43d3-8822-addf6a3643d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.463875 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-32724465-d79c-43d3-8822-addf6a3643d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.464313 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-32724465-d79c-43d3-8822-addf6a3643d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.605628 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-32724465-d79c-43d3-8822-addf6a3643d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lazy-loading 'flavor' on Instance uuid ba5b3667-5810-4568-976f-ca312dc065f4 {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:18:45.796661 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d160417f-018c-4c22-89c9-a3290174e59a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:45.809366 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d160417f-018c-4c22-89c9-a3290174e59a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1364 microversion: 2.1 time: 0.605770 Jun 07 13:18:45.810167 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 62/120] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:45 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1364 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:45.820257 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-c5120776-cd02-43a6-ad31-193240f48b22 req-36111ac4-ce6d-47d6-962e-4913ce57655c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bca688-1384-4f4d-a129-4129e290831c", "name": "network-vif-plugged", "status": "completed", "tag": "9fbff3a7-3340-450f-bac9-a55605b332c7"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:45.839941 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-c5120776-cd02-43a6-ad31-193240f48b22 req-36111ac4-ce6d-47d6-962e-4913ce57655c service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.840392 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-c5120776-cd02-43a6-ad31-193240f48b22 req-36111ac4-ce6d-47d6-962e-4913ce57655c service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.861474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-c5120776-cd02-43a6-ad31-193240f48b22 req-36111ac4-ce6d-47d6-962e-4913ce57655c service nova] Creating event network-vif-plugged:9fbff3a7-3340-450f-bac9-a55605b332c7 for instance 23bca688-1384-4f4d-a129-4129e290831c on hv-cinder-84460 Jun 07 13:18:45.861599 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-32724465-d79c-43d3-8822-addf6a3643d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4/action" status: 200 len: 32 microversion: 2.1 time: 0.417109 Jun 07 13:18:45.862348 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 59/121] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:18:45 2022] POST /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4/action => generated 32 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:18:45.872596 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-c5120776-cd02-43a6-ad31-193240f48b22 req-36111ac4-ce6d-47d6-962e-4913ce57655c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061060 Jun 07 13:18:45.873501 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 63/122] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:45.883684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6c53adec-4b1d-4cf6-a71d-27bbb3a0a48b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:45.884380 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6c53adec-4b1d-4cf6-a71d-27bbb3a0a48b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:45.887141 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5d54297f-e288-4cdc-9d0b-c1a63214c64f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dace7ea-a475-406e-918f-23aaf1e1757b"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:45.888591 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5d54297f-e288-4cdc-9d0b-c1a63214c64f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:45.896364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6c53adec-4b1d-4cf6-a71d-27bbb3a0a48b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.897033 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6c53adec-4b1d-4cf6-a71d-27bbb3a0a48b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.898229 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6c53adec-4b1d-4cf6-a71d-27bbb3a0a48b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.898880 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6c53adec-4b1d-4cf6-a71d-27bbb3a0a48b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.899862 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5d54297f-e288-4cdc-9d0b-c1a63214c64f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.900648 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5d54297f-e288-4cdc-9d0b-c1a63214c64f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.901611 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5d54297f-e288-4cdc-9d0b-c1a63214c64f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.902147 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5d54297f-e288-4cdc-9d0b-c1a63214c64f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:46.120871 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6c53adec-4b1d-4cf6-a71d-27bbb3a0a48b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:46.130588 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6c53adec-4b1d-4cf6-a71d-27bbb3a0a48b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.255032 Jun 07 13:18:46.140825 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 64/123] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:45 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:46.472693 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5d54297f-e288-4cdc-9d0b-c1a63214c64f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "POST /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.593918 Jun 07 13:18:46.473943 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 60/124] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:18:45 2022] POST /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:46.826022 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1df9751a-ba46-46df-a640-e39d9d59fcab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:46.827174 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1df9751a-ba46-46df-a640-e39d9d59fcab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:46.836482 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1df9751a-ba46-46df-a640-e39d9d59fcab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:46.836940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1df9751a-ba46-46df-a640-e39d9d59fcab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:46.837717 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1df9751a-ba46-46df-a640-e39d9d59fcab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:46.838156 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1df9751a-ba46-46df-a640-e39d9d59fcab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:47.117680 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1df9751a-ba46-46df-a640-e39d9d59fcab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:47.135162 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1df9751a-ba46-46df-a640-e39d9d59fcab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1554 microversion: 2.1 time: 0.308984 Jun 07 13:18:47.135162 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 65/125] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:46 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1554 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:47.151120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-58581b3b-864b-415d-bd26-5d9b43f7581c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:47.151469 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-dbfa315b-434a-4882-ba7a-057c6eacfc42 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:47.151974 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-dbfa315b-434a-4882-ba7a-057c6eacfc42 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:47.152569 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-58581b3b-864b-415d-bd26-5d9b43f7581c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:47.163195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58581b3b-864b-415d-bd26-5d9b43f7581c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:47.164805 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58581b3b-864b-415d-bd26-5d9b43f7581c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:47.165850 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58581b3b-864b-415d-bd26-5d9b43f7581c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:47.166978 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58581b3b-864b-415d-bd26-5d9b43f7581c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:47.169116 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dbfa315b-434a-4882-ba7a-057c6eacfc42 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:47.169572 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dbfa315b-434a-4882-ba7a-057c6eacfc42 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:47.170352 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dbfa315b-434a-4882-ba7a-057c6eacfc42 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:47.170787 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dbfa315b-434a-4882-ba7a-057c6eacfc42 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:47.340339 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-58581b3b-864b-415d-bd26-5d9b43f7581c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:47.349643 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-58581b3b-864b-415d-bd26-5d9b43f7581c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.205096 Jun 07 13:18:47.359831 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 61/126] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:47 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:47.504874 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-dbfa315b-434a-4882-ba7a-057c6eacfc42 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.357807 Jun 07 13:18:47.505489 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 66/127] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Jun 7 13:18:47 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-interface => generated 284 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:48.369464 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c9ea7f4f-fa22-44f8-99e2-e29283d533f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:48.370610 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c9ea7f4f-fa22-44f8-99e2-e29283d533f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:48.377256 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9ea7f4f-fa22-44f8-99e2-e29283d533f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:48.377934 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9ea7f4f-fa22-44f8-99e2-e29283d533f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:48.378961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9ea7f4f-fa22-44f8-99e2-e29283d533f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:48.379550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9ea7f4f-fa22-44f8-99e2-e29283d533f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:48.552153 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c9ea7f4f-fa22-44f8-99e2-e29283d533f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:48.561060 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c9ea7f4f-fa22-44f8-99e2-e29283d533f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.194968 Jun 07 13:18:48.561878 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 62/128] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:48 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:48.990642 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-d662bca5-29ca-4ef4-a12a-398729dfcc81 req-897698d6-9fa2-458a-970f-41f63a09480b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1184d0bc-4e76-42ed-8a67-6df8ce452b2e", "tag": "e938804d-36ef-4d7d-8a4a-5644b1bcebff"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:49.009020 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-d662bca5-29ca-4ef4-a12a-398729dfcc81 req-897698d6-9fa2-458a-970f-41f63a09480b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:49.010205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-d662bca5-29ca-4ef4-a12a-398729dfcc81 req-897698d6-9fa2-458a-970f-41f63a09480b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:49.025204 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-d662bca5-29ca-4ef4-a12a-398729dfcc81 req-897698d6-9fa2-458a-970f-41f63a09480b service nova] Creating event network-changed:e938804d-36ef-4d7d-8a4a-5644b1bcebff for instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e on hv-cinder-84460 Jun 07 13:18:49.033195 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-d662bca5-29ca-4ef4-a12a-398729dfcc81 req-897698d6-9fa2-458a-970f-41f63a09480b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047596 Jun 07 13:18:49.034502 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 67/129] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:49.579312 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-456e749a-a9cc-47e9-9925-88b408cefcb1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:49.579843 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-456e749a-a9cc-47e9-9925-88b408cefcb1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:49.587202 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-456e749a-a9cc-47e9-9925-88b408cefcb1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:49.587645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-456e749a-a9cc-47e9-9925-88b408cefcb1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:49.588424 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-456e749a-a9cc-47e9-9925-88b408cefcb1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:49.588860 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-456e749a-a9cc-47e9-9925-88b408cefcb1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:49.714682 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-456e749a-a9cc-47e9-9925-88b408cefcb1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:49.722595 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-456e749a-a9cc-47e9-9925-88b408cefcb1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.147287 Jun 07 13:18:49.723290 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 63/130] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:49 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:50.740918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e286bcdc-c572-40f8-81e3-9d0784004a82 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:50.741648 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e286bcdc-c572-40f8-81e3-9d0784004a82 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:50.747774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e286bcdc-c572-40f8-81e3-9d0784004a82 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:50.748225 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e286bcdc-c572-40f8-81e3-9d0784004a82 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:50.749035 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e286bcdc-c572-40f8-81e3-9d0784004a82 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:50.749472 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e286bcdc-c572-40f8-81e3-9d0784004a82 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:50.877759 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e286bcdc-c572-40f8-81e3-9d0784004a82 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:50.885837 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e286bcdc-c572-40f8-81e3-9d0784004a82 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.149791 Jun 07 13:18:50.886399 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 68/131] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:50 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:51.912153 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ac98f312-8886-4f81-a449-6ae94367270f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:51.912153 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ac98f312-8886-4f81-a449-6ae94367270f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:51.912153 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac98f312-8886-4f81-a449-6ae94367270f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:51.912153 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac98f312-8886-4f81-a449-6ae94367270f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:51.912924 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac98f312-8886-4f81-a449-6ae94367270f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:51.913463 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac98f312-8886-4f81-a449-6ae94367270f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:52.086176 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ac98f312-8886-4f81-a449-6ae94367270f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:52.094150 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ac98f312-8886-4f81-a449-6ae94367270f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.193715 Jun 07 13:18:52.097929 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 64/132] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:51 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:53.111801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2503b04d-ec34-4835-a942-5c398f8b833d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:53.112536 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2503b04d-ec34-4835-a942-5c398f8b833d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:53.119096 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2503b04d-ec34-4835-a942-5c398f8b833d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:53.119626 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2503b04d-ec34-4835-a942-5c398f8b833d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:53.120466 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2503b04d-ec34-4835-a942-5c398f8b833d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:53.120964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2503b04d-ec34-4835-a942-5c398f8b833d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:53.261280 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2503b04d-ec34-4835-a942-5c398f8b833d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:53.269044 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2503b04d-ec34-4835-a942-5c398f8b833d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.161009 Jun 07 13:18:53.269608 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 69/133] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:53 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:54.285418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e3dfa220-6b4c-4e1f-ae59-41fa3185aa09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:54.286024 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e3dfa220-6b4c-4e1f-ae59-41fa3185aa09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:54.293009 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3dfa220-6b4c-4e1f-ae59-41fa3185aa09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:54.293664 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3dfa220-6b4c-4e1f-ae59-41fa3185aa09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:54.294500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3dfa220-6b4c-4e1f-ae59-41fa3185aa09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:54.295037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3dfa220-6b4c-4e1f-ae59-41fa3185aa09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:54.434257 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e3dfa220-6b4c-4e1f-ae59-41fa3185aa09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:54.441681 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e3dfa220-6b4c-4e1f-ae59-41fa3185aa09 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.160038 Jun 07 13:18:54.447362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 65/134] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:54 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:55.458432 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1608f8de-1413-4214-a704-516f85e3c86a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:55.459119 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1608f8de-1413-4214-a704-516f85e3c86a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:55.465185 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1608f8de-1413-4214-a704-516f85e3c86a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:55.465633 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1608f8de-1413-4214-a704-516f85e3c86a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:55.466395 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1608f8de-1413-4214-a704-516f85e3c86a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:55.466921 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1608f8de-1413-4214-a704-516f85e3c86a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:55.597388 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1608f8de-1413-4214-a704-516f85e3c86a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:55.605401 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1608f8de-1413-4214-a704-516f85e3c86a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.150873 Jun 07 13:18:55.606031 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 70/135] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:55 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:56.623744 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4f30bc29-1e20-49e7-87d9-2c95d878eb74 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:56.624940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4f30bc29-1e20-49e7-87d9-2c95d878eb74 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:56.632537 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f30bc29-1e20-49e7-87d9-2c95d878eb74 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:56.633245 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f30bc29-1e20-49e7-87d9-2c95d878eb74 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:56.634238 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f30bc29-1e20-49e7-87d9-2c95d878eb74 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:56.634759 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f30bc29-1e20-49e7-87d9-2c95d878eb74 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:56.788348 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4f30bc29-1e20-49e7-87d9-2c95d878eb74 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:56.796941 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4f30bc29-1e20-49e7-87d9-2c95d878eb74 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.177304 Jun 07 13:18:56.797511 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 66/136] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:56 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:57.814343 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8dc61572-b7e7-4e16-9794-2aa8ab892c54 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:57.818856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8dc61572-b7e7-4e16-9794-2aa8ab892c54 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:57.835155 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8dc61572-b7e7-4e16-9794-2aa8ab892c54 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:57.835155 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8dc61572-b7e7-4e16-9794-2aa8ab892c54 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:57.838172 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8dc61572-b7e7-4e16-9794-2aa8ab892c54 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:57.838292 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8dc61572-b7e7-4e16-9794-2aa8ab892c54 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:58.009056 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8dc61572-b7e7-4e16-9794-2aa8ab892c54 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:58.017086 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8dc61572-b7e7-4e16-9794-2aa8ab892c54 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.206512 Jun 07 13:18:58.017663 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 71/137] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:57 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:59.035336 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-92c63bd0-f85d-4e71-997d-ecc029b6136c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:59.040414 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-92c63bd0-f85d-4e71-997d-ecc029b6136c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:59.048201 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=62 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:59.050645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-92c63bd0-f85d-4e71-997d-ecc029b6136c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:59.051151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-92c63bd0-f85d-4e71-997d-ecc029b6136c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:59.052089 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-92c63bd0-f85d-4e71-997d-ecc029b6136c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:59.052855 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-92c63bd0-f85d-4e71-997d-ecc029b6136c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:59.073275 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:59.230973 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-92c63bd0-f85d-4e71-997d-ecc029b6136c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:59.238492 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-92c63bd0-f85d-4e71-997d-ecc029b6136c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.208268 Jun 07 13:18:59.248031 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 67/138] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:59 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:59.673697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6966f041-44fa-4043-a8d5-85e27154bde0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:59.674206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6966f041-44fa-4043-a8d5-85e27154bde0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:59.680686 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=66 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:59.682159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6966f041-44fa-4043-a8d5-85e27154bde0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:59.682620 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6966f041-44fa-4043-a8d5-85e27154bde0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:59.683485 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6966f041-44fa-4043-a8d5-85e27154bde0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:59.683931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6966f041-44fa-4043-a8d5-85e27154bde0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:59.715657 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6966f041-44fa-4043-a8d5-85e27154bde0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:18:59.832552 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6966f041-44fa-4043-a8d5-85e27154bde0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "DELETE /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 204 len: 0 microversion: 2.1 time: 0.163600 Jun 07 13:18:59.835026 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 72/139] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:18:59 2022] DELETE /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:18:59.844558 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ebaff857-0003-408c-b319-fa003fea5e17 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:59.845430 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ebaff857-0003-408c-b319-fa003fea5e17 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:59.852543 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ebaff857-0003-408c-b319-fa003fea5e17 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:59.853182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ebaff857-0003-408c-b319-fa003fea5e17 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:59.854103 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ebaff857-0003-408c-b319-fa003fea5e17 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:59.854690 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ebaff857-0003-408c-b319-fa003fea5e17 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.044441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ebaff857-0003-408c-b319-fa003fea5e17 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:00.053858 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ebaff857-0003-408c-b319-fa003fea5e17 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1553 microversion: 2.1 time: 0.214269 Jun 07 13:19:00.055849 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 68/140] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:59 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:00.256722 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e3af828b-4d93-4a4b-883a-0ddd858d85a7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:00.257505 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e3af828b-4d93-4a4b-883a-0ddd858d85a7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:00.263809 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e3af828b-4d93-4a4b-883a-0ddd858d85a7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.264350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e3af828b-4d93-4a4b-883a-0ddd858d85a7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.265213 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e3af828b-4d93-4a4b-883a-0ddd858d85a7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.265725 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e3af828b-4d93-4a4b-883a-0ddd858d85a7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.475944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e3af828b-4d93-4a4b-883a-0ddd858d85a7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:00.484139 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e3af828b-4d93-4a4b-883a-0ddd858d85a7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.232383 Jun 07 13:19:00.484730 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 73/141] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:00 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:01.075787 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-afe97806-14f1-496c-b4d3-d4392311e99b tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:01.076524 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-afe97806-14f1-496c-b4d3-d4392311e99b tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:01.083651 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-afe97806-14f1-496c-b4d3-d4392311e99b tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.084309 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-afe97806-14f1-496c-b4d3-d4392311e99b tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.085373 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-afe97806-14f1-496c-b4d3-d4392311e99b tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.086015 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-afe97806-14f1-496c-b4d3-d4392311e99b tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.292758 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-afe97806-14f1-496c-b4d3-d4392311e99b tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:01.302198 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-afe97806-14f1-496c-b4d3-d4392311e99b tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1553 microversion: 2.1 time: 0.230729 Jun 07 13:19:01.303174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 69/142] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:01 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:01.501562 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-dd6e15a8-e36f-41e2-95fe-99da7e78125b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:01.502378 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-dd6e15a8-e36f-41e2-95fe-99da7e78125b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:01.508901 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd6e15a8-e36f-41e2-95fe-99da7e78125b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.509303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd6e15a8-e36f-41e2-95fe-99da7e78125b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.510140 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd6e15a8-e36f-41e2-95fe-99da7e78125b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.510646 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd6e15a8-e36f-41e2-95fe-99da7e78125b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.513466 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:01.669595 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-dd6e15a8-e36f-41e2-95fe-99da7e78125b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:01.679254 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-dd6e15a8-e36f-41e2-95fe-99da7e78125b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.181622 Jun 07 13:19:01.680764 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 74/143] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:01 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:02.321227 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-18d88e26-c7ab-434e-8393-75500625315f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:02.322336 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-18d88e26-c7ab-434e-8393-75500625315f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:02.330895 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-18d88e26-c7ab-434e-8393-75500625315f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:02.332728 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-18d88e26-c7ab-434e-8393-75500625315f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:02.334018 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-18d88e26-c7ab-434e-8393-75500625315f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:02.334552 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-18d88e26-c7ab-434e-8393-75500625315f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:02.502343 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-18d88e26-c7ab-434e-8393-75500625315f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:02.511052 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-18d88e26-c7ab-434e-8393-75500625315f tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1553 microversion: 2.1 time: 0.195446 Jun 07 13:19:02.512930 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 70/144] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:02 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:02.697314 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-615095cf-a60e-40bf-85ae-0666486c2c68 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:02.698436 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-615095cf-a60e-40bf-85ae-0666486c2c68 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:02.705292 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-615095cf-a60e-40bf-85ae-0666486c2c68 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:02.705836 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-615095cf-a60e-40bf-85ae-0666486c2c68 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:02.706731 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-615095cf-a60e-40bf-85ae-0666486c2c68 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:02.707539 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-615095cf-a60e-40bf-85ae-0666486c2c68 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:02.868992 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-615095cf-a60e-40bf-85ae-0666486c2c68 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:02.881762 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-615095cf-a60e-40bf-85ae-0666486c2c68 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.188402 Jun 07 13:19:02.883626 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 75/145] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:02 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:03.529435 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-24aa3134-5dfb-4d1b-bfce-4fc42b30a2bb tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:03.530099 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-24aa3134-5dfb-4d1b-bfce-4fc42b30a2bb tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:03.537297 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-24aa3134-5dfb-4d1b-bfce-4fc42b30a2bb tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.538169 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-24aa3134-5dfb-4d1b-bfce-4fc42b30a2bb tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.538881 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-24aa3134-5dfb-4d1b-bfce-4fc42b30a2bb tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.539514 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-24aa3134-5dfb-4d1b-bfce-4fc42b30a2bb tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.561221 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-fb59635a-3d11-4b08-8726-3017dfc72531 req-c92bb6e4-d8be-4349-baa4-56eeedd6359c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83302c71-926e-4dfe-9285-936bb6f07ce8", "name": "network-vif-deleted", "tag": "042bd4fd-49bb-4c75-a83c-ad7a363bf2c1"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:03.576057 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-fb59635a-3d11-4b08-8726-3017dfc72531 req-c92bb6e4-d8be-4349-baa4-56eeedd6359c service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.576591 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-fb59635a-3d11-4b08-8726-3017dfc72531 req-c92bb6e4-d8be-4349-baa4-56eeedd6359c service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.590532 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-fb59635a-3d11-4b08-8726-3017dfc72531 req-c92bb6e4-d8be-4349-baa4-56eeedd6359c service nova] Creating event network-vif-deleted:042bd4fd-49bb-4c75-a83c-ad7a363bf2c1 for instance 83302c71-926e-4dfe-9285-936bb6f07ce8 on hv-cinder-84460 Jun 07 13:19:03.595512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-fb59635a-3d11-4b08-8726-3017dfc72531 req-c92bb6e4-d8be-4349-baa4-56eeedd6359c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037779 Jun 07 13:19:03.596729 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 76/146] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:03.651647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-24aa3134-5dfb-4d1b-bfce-4fc42b30a2bb tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106d1325381147b1ba157f2d54d0388c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b95f79de5724987ab6c9fddb86a84f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:03.660009 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-24aa3134-5dfb-4d1b-bfce-4fc42b30a2bb tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 200 len: 1511 microversion: 2.1 time: 0.134470 Jun 07 13:19:03.663340 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 71/147] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:03 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 1511 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:03.900952 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c3c875cd-9f6e-4d2f-a20a-c8df85e33c1d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:03.901675 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c3c875cd-9f6e-4d2f-a20a-c8df85e33c1d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:03.907984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c3c875cd-9f6e-4d2f-a20a-c8df85e33c1d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.908444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c3c875cd-9f6e-4d2f-a20a-c8df85e33c1d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.909209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c3c875cd-9f6e-4d2f-a20a-c8df85e33c1d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.909658 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c3c875cd-9f6e-4d2f-a20a-c8df85e33c1d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.066288 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c3c875cd-9f6e-4d2f-a20a-c8df85e33c1d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:04.074821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c3c875cd-9f6e-4d2f-a20a-c8df85e33c1d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.177947 Jun 07 13:19:04.075651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 77/148] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:03 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:04.679456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:04.680600 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:04.690736 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:04.693304 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.694336 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:04.702460 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.719423 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] HTTP exception thrown: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Request method failure captured: Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 HTTP/1.1 Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1AIhdIK_gY7ku1FQqBFfAjNydOahKz9S8N_dhNTzfahVrgiOC-SgL0SsQdjDVziFwxhu1GzDjimd_f-WlV-AMk8q_bv-B77pQyuOYrslZH9-cBg5S6_Y3hCm_w7lvYrkrMD5MhIzHycctcngNHr9pA33ITptRZ_YOr23mBl8uuvxUs Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 7b95f79de5724987ab6c9fddb86a84f0 Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:19:04.729890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 7b95f79de5724987ab6c9fddb86a84f0 Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-DeleteServersTestJSON-1557703629-project Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 106d1325381147b1ba157f2d54d0388c Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-DeleteServersTestJSON-1557703629-project Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.731415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '83302c71-926e-4dfe-9285-936bb6f07ce8'} Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:04.732246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.733674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.736401 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Returning 404 to user: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:04.737755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f4c0f334-bf3d-4f10-80e2-b7d6da74f744 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 404 len: 111 microversion: 2.1 time: 0.063195 Jun 07 13:19:04.739926 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 72/149] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:04 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:19:04.936515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:04.936515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:04.943814 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:04.944283 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.945138 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:04.945500 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.961949 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] HTTP exception thrown: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Request method failure captured: Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8/os-volume_attachments HTTP/1.1 Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1AIhdIK_gY7ku1FQqBFfAjNydOahKz9S8N_dhNTzfahVrgiOC-SgL0SsQdjDVziFwxhu1GzDjimd_f-WlV-AMk8q_bv-B77pQyuOYrslZH9-cBg5S6_Y3hCm_w7lvYrkrMD5MhIzHycctcngNHr9pA33ITptRZ_YOr23mBl8uuvxUs Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 7b95f79de5724987ab6c9fddb86a84f0 Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:19:04.966758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 7b95f79de5724987ab6c9fddb86a84f0 Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-DeleteServersTestJSON-1557703629-project Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 106d1325381147b1ba157f2d54d0388c Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-DeleteServersTestJSON-1557703629-project Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.968082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'server_id': '83302c71-926e-4dfe-9285-936bb6f07ce8'} Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:04.968872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:04.969944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.973173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Returning 404 to user: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:04.974075 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8f8dd469-95e2-455c-9236-0cd70b81b0e1 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049266 Jun 07 13:19:04.975213 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 78/150] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:19:04 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:19:05.092896 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-605a8597-efab-4b06-ac1f-66d17c7633a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:05.093930 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-605a8597-efab-4b06-ac1f-66d17c7633a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:05.101956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-605a8597-efab-4b06-ac1f-66d17c7633a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:05.102611 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-605a8597-efab-4b06-ac1f-66d17c7633a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:05.103902 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-605a8597-efab-4b06-ac1f-66d17c7633a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:05.104518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-605a8597-efab-4b06-ac1f-66d17c7633a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:05.294718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-605a8597-efab-4b06-ac1f-66d17c7633a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:05.304340 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-605a8597-efab-4b06-ac1f-66d17c7633a3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.215299 Jun 07 13:19:05.304932 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 73/151] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:05 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:06.321228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6eb8f354-b62c-4be8-8a49-714b6ee9800a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:06.321881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6eb8f354-b62c-4be8-8a49-714b6ee9800a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:06.328112 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6eb8f354-b62c-4be8-8a49-714b6ee9800a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.328587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6eb8f354-b62c-4be8-8a49-714b6ee9800a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.329350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6eb8f354-b62c-4be8-8a49-714b6ee9800a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.329790 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6eb8f354-b62c-4be8-8a49-714b6ee9800a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.471098 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6eb8f354-b62c-4be8-8a49-714b6ee9800a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:06.479770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6eb8f354-b62c-4be8-8a49-714b6ee9800a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.162601 Jun 07 13:19:06.480336 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 79/152] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:06 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:06.490477 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:06.491060 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:06.497653 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.498225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.499094 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.499742 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.515412 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] HTTP exception thrown: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Request method failure captured: Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 HTTP/1.1 Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1AIhdIK_gY7ku1FQqBFfAjNydOahKz9S8N_dhNTzfahVrgiOC-SgL0SsQdjDVziFwxhu1GzDjimd_f-WlV-AMk8q_bv-B77pQyuOYrslZH9-cBg5S6_Y3hCm_w7lvYrkrMD5MhIzHycctcngNHr9pA33ITptRZ_YOr23mBl8uuvxUs Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 7b95f79de5724987ab6c9fddb86a84f0 Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:19:06.517114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 7b95f79de5724987ab6c9fddb86a84f0 Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-DeleteServersTestJSON-1557703629-project Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 106d1325381147b1ba157f2d54d0388c Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-DeleteServersTestJSON-1557703629-project Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.518344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '83302c71-926e-4dfe-9285-936bb6f07ce8'} Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:06.519049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.520121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.521845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Returning 404 to user: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:06.521845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7126230e-a2df-41b7-9857-c813455a36e0 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "DELETE /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 404 len: 111 microversion: 2.1 time: 0.031938 Jun 07 13:19:06.521845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 74/153] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:19:06 2022] DELETE /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:19:06.530024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:06.530791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] [instance: 83302c71-926e-4dfe-9285-936bb6f07ce8] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:06.537604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.538114 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.539077 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.539518 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.553827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] HTTP exception thrown: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Request method failure captured: Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 HTTP/1.1 Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1AIhdIK_gY7ku1FQqBFfAjNydOahKz9S8N_dhNTzfahVrgiOC-SgL0SsQdjDVziFwxhu1GzDjimd_f-WlV-AMk8q_bv-B77pQyuOYrslZH9-cBg5S6_Y3hCm_w7lvYrkrMD5MhIzHycctcngNHr9pA33ITptRZ_YOr23mBl8uuvxUs Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 7b95f79de5724987ab6c9fddb86a84f0 Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:19:06.556612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7b95f79de5724987ab6c9fddb86a84f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 7b95f79de5724987ab6c9fddb86a84f0 Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1557703629 Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-DeleteServersTestJSON-1557703629-project Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 106d1325381147b1ba157f2d54d0388c Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-DeleteServersTestJSON-1557703629-project Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.557922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '83302c71-926e-4dfe-9285-936bb6f07ce8'} Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:06.558984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. Jun 07 13:19:06.560651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:19:06.561827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] Returning 404 to user: Instance 83302c71-926e-4dfe-9285-936bb6f07ce8 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:06.561827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1897938d-e0aa-4dfe-af62-57440793fa87 tempest-DeleteServersTestJSON-1557703629 tempest-DeleteServersTestJSON-1557703629-project] 10.222.0.61 "GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8" status: 404 len: 111 microversion: 2.1 time: 0.031765 Jun 07 13:19:06.561966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 80/154] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:06 2022] GET /compute/v2.1/servers/83302c71-926e-4dfe-9285-936bb6f07ce8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:19:07.497696 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b2dc6511-5654-4743-a91a-9d38fc22943f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:07.498379 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b2dc6511-5654-4743-a91a-9d38fc22943f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:07.510388 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b2dc6511-5654-4743-a91a-9d38fc22943f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:07.512906 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b2dc6511-5654-4743-a91a-9d38fc22943f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:07.514351 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b2dc6511-5654-4743-a91a-9d38fc22943f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:07.515195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b2dc6511-5654-4743-a91a-9d38fc22943f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:07.725417 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b2dc6511-5654-4743-a91a-9d38fc22943f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:07.741377 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b2dc6511-5654-4743-a91a-9d38fc22943f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.247485 Jun 07 13:19:07.742564 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 75/155] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:07 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:08.760889 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d30fb7a4-bb11-4c90-9b3c-552d83546336 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:08.762114 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d30fb7a4-bb11-4c90-9b3c-552d83546336 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:08.786083 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d30fb7a4-bb11-4c90-9b3c-552d83546336 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:08.786847 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d30fb7a4-bb11-4c90-9b3c-552d83546336 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:08.788024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d30fb7a4-bb11-4c90-9b3c-552d83546336 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:08.788461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d30fb7a4-bb11-4c90-9b3c-552d83546336 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:08.990256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d30fb7a4-bb11-4c90-9b3c-552d83546336 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:09.002122 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d30fb7a4-bb11-4c90-9b3c-552d83546336 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.247178 Jun 07 13:19:09.008342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 81/156] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:08 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:10.021283 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f4957ba2-ba9e-45e0-804c-e5dd09e5a87e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:10.022684 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f4957ba2-ba9e-45e0-804c-e5dd09e5a87e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:10.030101 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4957ba2-ba9e-45e0-804c-e5dd09e5a87e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:10.030819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4957ba2-ba9e-45e0-804c-e5dd09e5a87e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:10.031647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4957ba2-ba9e-45e0-804c-e5dd09e5a87e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:10.032086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4957ba2-ba9e-45e0-804c-e5dd09e5a87e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:10.211025 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f4957ba2-ba9e-45e0-804c-e5dd09e5a87e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:10.222441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f4957ba2-ba9e-45e0-804c-e5dd09e5a87e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.206192 Jun 07 13:19:10.223377 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 76/157] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:10 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:11.240613 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-32431a69-001b-44d0-b4db-beccdb33049d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:11.241297 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-32431a69-001b-44d0-b4db-beccdb33049d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:11.249323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-32431a69-001b-44d0-b4db-beccdb33049d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:11.249738 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-32431a69-001b-44d0-b4db-beccdb33049d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:11.250695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-32431a69-001b-44d0-b4db-beccdb33049d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:11.251329 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-32431a69-001b-44d0-b4db-beccdb33049d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:11.449621 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-32431a69-001b-44d0-b4db-beccdb33049d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:11.457592 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-32431a69-001b-44d0-b4db-beccdb33049d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.221398 Jun 07 13:19:11.458224 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 82/158] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:11 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:12.482167 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0e0d66f5-dcf1-4ef2-b632-86581e51701e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:12.483417 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0e0d66f5-dcf1-4ef2-b632-86581e51701e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:12.498167 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0e0d66f5-dcf1-4ef2-b632-86581e51701e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:12.499790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0e0d66f5-dcf1-4ef2-b632-86581e51701e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:12.502447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0e0d66f5-dcf1-4ef2-b632-86581e51701e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:12.504347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0e0d66f5-dcf1-4ef2-b632-86581e51701e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:12.807904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0e0d66f5-dcf1-4ef2-b632-86581e51701e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:12.818436 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0e0d66f5-dcf1-4ef2-b632-86581e51701e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.347887 Jun 07 13:19:12.819904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 77/159] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:12 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:13.836819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ef51de40-e80a-4997-af56-101ac41f9721 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:13.837372 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ef51de40-e80a-4997-af56-101ac41f9721 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:13.851283 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ef51de40-e80a-4997-af56-101ac41f9721 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:13.851953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ef51de40-e80a-4997-af56-101ac41f9721 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:13.853488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ef51de40-e80a-4997-af56-101ac41f9721 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:13.857669 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ef51de40-e80a-4997-af56-101ac41f9721 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:14.198812 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ef51de40-e80a-4997-af56-101ac41f9721 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:14.214553 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ef51de40-e80a-4997-af56-101ac41f9721 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.377866 Jun 07 13:19:14.215264 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 83/160] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:13 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:15.235758 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-96505f1d-4ce7-43c8-802e-3e812aeaa993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:15.236545 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-96505f1d-4ce7-43c8-802e-3e812aeaa993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:15.250617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96505f1d-4ce7-43c8-802e-3e812aeaa993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:15.251552 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96505f1d-4ce7-43c8-802e-3e812aeaa993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.253361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96505f1d-4ce7-43c8-802e-3e812aeaa993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:15.254938 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96505f1d-4ce7-43c8-802e-3e812aeaa993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.556175 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-96505f1d-4ce7-43c8-802e-3e812aeaa993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:15.574099 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-96505f1d-4ce7-43c8-802e-3e812aeaa993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.345490 Jun 07 13:19:15.577414 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 78/161] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:15 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:16.594582 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9a4a4e4d-4d8a-42fb-ad9c-5a8cdfd97c46 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:16.596017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9a4a4e4d-4d8a-42fb-ad9c-5a8cdfd97c46 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:16.617422 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a4a4e4d-4d8a-42fb-ad9c-5a8cdfd97c46 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.617878 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a4a4e4d-4d8a-42fb-ad9c-5a8cdfd97c46 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:16.618656 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a4a4e4d-4d8a-42fb-ad9c-5a8cdfd97c46 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.619179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a4a4e4d-4d8a-42fb-ad9c-5a8cdfd97c46 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:16.894947 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9a4a4e4d-4d8a-42fb-ad9c-5a8cdfd97c46 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:16.903814 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9a4a4e4d-4d8a-42fb-ad9c-5a8cdfd97c46 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.314183 Jun 07 13:19:16.904536 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 84/162] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:16 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:17.535732 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-12063af0-2041-466b-98b9-1b316bb7bccf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'create', calling method: .version_select at 0x7f46a820b550>, body: {"keypair": {"name": "tempest-keypair-893387912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUyp8aimcOaijn+ViMdNZL9eNXNjF0DuuDUkOGehkXhsX4QuBba1FWDjvHKQPJn885I3nEA5uWUgDSZ2I/jpQLXLTaVYOjl65HWe7hSpmWV31cSXK7dyOU6y5eywX1OCw=="}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:17.560756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-12063af0-2041-466b-98b9-1b316bb7bccf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Getting quotas for project 346889f9c6334aa9a22bd277aa002a0f. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:17.569202 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-12063af0-2041-466b-98b9-1b316bb7bccf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Getting quotas for user 326e0d70244f46059664a135aefab0f0 and project 346889f9c6334aa9a22bd277aa002a0f. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:17.633728 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-12063af0-2041-466b-98b9-1b316bb7bccf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.249263 Jun 07 13:19:17.634490 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 79/163] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Jun 7 13:19:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 13:19:17.927962 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9212ce0e-54bf-4d35-b2ac-928a5153a733 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:17.929704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9212ce0e-54bf-4d35-b2ac-928a5153a733 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:17.943673 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9212ce0e-54bf-4d35-b2ac-928a5153a733 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:17.944029 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9212ce0e-54bf-4d35-b2ac-928a5153a733 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:17.944964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9212ce0e-54bf-4d35-b2ac-928a5153a733 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:17.945433 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9212ce0e-54bf-4d35-b2ac-928a5153a733 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.190059 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9212ce0e-54bf-4d35-b2ac-928a5153a733 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:18.202303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9212ce0e-54bf-4d35-b2ac-928a5153a733 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.285232 Jun 07 13:19:18.202803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 85/164] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:17 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:19.226390 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4857f51a-08dd-4e9e-812f-c91d0cf98c79 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:19.228502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4857f51a-08dd-4e9e-812f-c91d0cf98c79 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:19.237356 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4857f51a-08dd-4e9e-812f-c91d0cf98c79 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:19.238514 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4857f51a-08dd-4e9e-812f-c91d0cf98c79 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:19.240189 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4857f51a-08dd-4e9e-812f-c91d0cf98c79 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:19.241620 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4857f51a-08dd-4e9e-812f-c91d0cf98c79 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:19.620079 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4857f51a-08dd-4e9e-812f-c91d0cf98c79 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:19.628518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4857f51a-08dd-4e9e-812f-c91d0cf98c79 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.411883 Jun 07 13:19:19.637611 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 80/165] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:19 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:20.058249 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1586548549", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3f69c49-b140-4944-b465-9f2708e8aff6"}], "security_groups": [{"name": "tempest-securitygroup--954093286"}], "key_name": "tempest-keypair-893387912", "user_data": "}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:20.651853 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2a16ef0a-0a1f-4d9b-961f-ee9e84e13f53 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:20.652381 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2a16ef0a-0a1f-4d9b-961f-ee9e84e13f53 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:20.661137 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2a16ef0a-0a1f-4d9b-961f-ee9e84e13f53 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:20.661546 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2a16ef0a-0a1f-4d9b-961f-ee9e84e13f53 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:20.662318 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2a16ef0a-0a1f-4d9b-961f-ee9e84e13f53 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:20.662752 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2a16ef0a-0a1f-4d9b-961f-ee9e84e13f53 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:20.824853 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2a16ef0a-0a1f-4d9b-961f-ee9e84e13f53 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:20.832727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2a16ef0a-0a1f-4d9b-961f-ee9e84e13f53 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.189600 Jun 07 13:19:20.833864 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 81/166] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:20 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:21.850303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-abb4a8b0-43f0-4c6f-a48b-abba1d95880b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:21.851032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-abb4a8b0-43f0-4c6f-a48b-abba1d95880b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:21.857507 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abb4a8b0-43f0-4c6f-a48b-abba1d95880b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:21.858073 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abb4a8b0-43f0-4c6f-a48b-abba1d95880b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:21.858927 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abb4a8b0-43f0-4c6f-a48b-abba1d95880b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:21.859574 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abb4a8b0-43f0-4c6f-a48b-abba1d95880b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:22.005018 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-abb4a8b0-43f0-4c6f-a48b-abba1d95880b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:22.013418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-abb4a8b0-43f0-4c6f-a48b-abba1d95880b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.167660 Jun 07 13:19:22.013863 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 82/167] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:21 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:23.029457 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b65f07fa-6a3f-42aa-88a8-375a993043eb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:23.030051 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b65f07fa-6a3f-42aa-88a8-375a993043eb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:23.038381 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b65f07fa-6a3f-42aa-88a8-375a993043eb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:23.039053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b65f07fa-6a3f-42aa-88a8-375a993043eb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:23.040232 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b65f07fa-6a3f-42aa-88a8-375a993043eb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:23.041006 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b65f07fa-6a3f-42aa-88a8-375a993043eb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:23.203581 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b65f07fa-6a3f-42aa-88a8-375a993043eb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:23.212178 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b65f07fa-6a3f-42aa-88a8-375a993043eb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.186704 Jun 07 13:19:23.212751 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 83/168] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:23 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:24.229241 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5a78375e-a09f-4065-9431-45efc1bd8faf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:24.229867 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5a78375e-a09f-4065-9431-45efc1bd8faf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:24.240799 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5a78375e-a09f-4065-9431-45efc1bd8faf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:24.241921 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5a78375e-a09f-4065-9431-45efc1bd8faf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:24.244137 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5a78375e-a09f-4065-9431-45efc1bd8faf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:24.245542 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5a78375e-a09f-4065-9431-45efc1bd8faf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:24.404931 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5a78375e-a09f-4065-9431-45efc1bd8faf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:24.414805 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5a78375e-a09f-4065-9431-45efc1bd8faf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.189718 Jun 07 13:19:24.425335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 84/169] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:24 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:25.435407 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ec115585-1460-4a8c-8696-f85a4a981ac0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:25.435870 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ec115585-1460-4a8c-8696-f85a4a981ac0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:25.446857 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ec115585-1460-4a8c-8696-f85a4a981ac0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:25.448182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ec115585-1460-4a8c-8696-f85a4a981ac0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:25.449035 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ec115585-1460-4a8c-8696-f85a4a981ac0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:25.449470 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ec115585-1460-4a8c-8696-f85a4a981ac0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:25.635288 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ec115585-1460-4a8c-8696-f85a4a981ac0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:25.647762 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ec115585-1460-4a8c-8696-f85a4a981ac0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.217807 Jun 07 13:19:25.648444 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 85/170] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:25 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:26.665720 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d128917b-8043-457a-b78e-81a3c8c91cbb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:26.667004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d128917b-8043-457a-b78e-81a3c8c91cbb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:26.675412 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d128917b-8043-457a-b78e-81a3c8c91cbb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:26.676461 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d128917b-8043-457a-b78e-81a3c8c91cbb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:26.679237 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d128917b-8043-457a-b78e-81a3c8c91cbb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:26.679821 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d128917b-8043-457a-b78e-81a3c8c91cbb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:26.699281 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=100 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:26.813058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d128917b-8043-457a-b78e-81a3c8c91cbb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:26.822216 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d128917b-8043-457a-b78e-81a3c8c91cbb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.160273 Jun 07 13:19:26.830095 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 86/171] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:26 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:27.783840 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=4 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:27.789698 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-193213634", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "networks": [{"uuid": "58ad666e-46d6-4776-ba36-924ba1b46cc1"}]}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:28.195420 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=59 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:29.269971 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] validate_networks() for [('58ad666e-46d6-4776-ba36-924ba1b46cc1', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:19:29.369423 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] validate_networks() for [('f3f69c49-b140-4944-b465-9f2708e8aff6', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:19:29.836563 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:19:29.836990 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:19:29.837459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:19:29.837864 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:19:29.838274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:19:29.840347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:29.851272 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:29.851721 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:29.852524 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:29.852957 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:29.869393 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Getting quotas for project d1aac41f4f074858ba560987a158c38b. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:29.873376 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Getting quotas for user 51d5d87476eb4c8d8ceacf022fe4135d and project d1aac41f4f074858ba560987a158c38b. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:29.884460 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:19:29.886757 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:19:29.945029 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c613e921-6c2c-4442-be93-059fd56c239f tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.161786 Jun 07 13:19:29.945912 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 87/172] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:19:29.950692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4239bc87-171d-451c-aa12-237a579dd46c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:29.951163 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4239bc87-171d-451c-aa12-237a579dd46c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:29.958735 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4239bc87-171d-451c-aa12-237a579dd46c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:29.959252 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4239bc87-171d-451c-aa12-237a579dd46c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:29.960020 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4239bc87-171d-451c-aa12-237a579dd46c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:29.960494 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4239bc87-171d-451c-aa12-237a579dd46c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:30.158277 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:19:30.158766 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:19:30.159266 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:19:30.159703 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:19:30.160145 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:19:30.164723 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:30.173050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:30.173430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:30.174371 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:30.174885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:30.195831 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Getting quotas for project 346889f9c6334aa9a22bd277aa002a0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:30.199164 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4239bc87-171d-451c-aa12-237a579dd46c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:30.200040 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Getting quotas for user 326e0d70244f46059664a135aefab0f0 and project 346889f9c6334aa9a22bd277aa002a0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:30.207829 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4239bc87-171d-451c-aa12-237a579dd46c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.261129 Jun 07 13:19:30.218231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 88/173] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:29 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:30.218231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1432100045", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:30.223170 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:19:30.225994 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:19:30.275294 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] validate_networks() for None {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:19:30.287779 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6300b7c2-4002-44e1-9ddb-82f7936cb89f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 10.235221 Jun 07 13:19:30.289181 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 86/174] 10.222.0.61 () {62 vars in 1187 bytes} [Tue Jun 7 13:19:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 10238 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 13:19:30.294313 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a106038a-8b5e-449c-b961-8e0e064b8639 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:30.295464 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a106038a-8b5e-449c-b961-8e0e064b8639 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:30.400815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a106038a-8b5e-449c-b961-8e0e064b8639 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:30.417988 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a106038a-8b5e-449c-b961-8e0e064b8639 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1213 microversion: 2.1 time: 0.127262 Jun 07 13:19:30.418573 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 87/175] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:30 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:30.427413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fee68431-967c-462f-a16d-d6855cc3f401 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:30.436111 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fee68431-967c-462f-a16d-d6855cc3f401 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:30.573274 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fee68431-967c-462f-a16d-d6855cc3f401 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:30.592280 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fee68431-967c-462f-a16d-d6855cc3f401 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:30.593804 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fee68431-967c-462f-a16d-d6855cc3f401 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:30.601592 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fee68431-967c-462f-a16d-d6855cc3f401 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1281 microversion: 2.20 time: 0.177951 Jun 07 13:19:30.603271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 88/176] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:30 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1281 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:30.759016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:19:30.759543 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:19:30.760142 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:19:30.760614 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:19:30.761090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:19:30.771625 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:30.772111 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:30.773029 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:30.773446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:30.791426 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Getting quotas for project 8c38e45e60ff4f5595a4b3bec32db245. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:30.795434 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Getting quotas for user e15c2a65a3434df5abf5dc4ce53fddc2 and project 8c38e45e60ff4f5595a4b3bec32db245. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:30.806628 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:19:30.808862 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:19:30.855482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fb762b9e-e2d1-4fbc-9007-99644cfa456d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645128 Jun 07 13:19:30.856352 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 89/177] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:19:30.866399 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c863499f-ac79-4e9d-8462-e9e49067e47a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:30.867046 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c863499f-ac79-4e9d-8462-e9e49067e47a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:30.918355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c863499f-ac79-4e9d-8462-e9e49067e47a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:30.926362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c863499f-ac79-4e9d-8462-e9e49067e47a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1215 microversion: 2.1 time: 0.063827 Jun 07 13:19:30.926987 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 89/178] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:30 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:31.225634 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-579c89dc-fa3f-4dcf-ae5d-c7d837b9d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:31.226252 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-579c89dc-fa3f-4dcf-ae5d-c7d837b9d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:31.232974 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-579c89dc-fa3f-4dcf-ae5d-c7d837b9d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.233429 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-579c89dc-fa3f-4dcf-ae5d-c7d837b9d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:31.234209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-579c89dc-fa3f-4dcf-ae5d-c7d837b9d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.234653 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-579c89dc-fa3f-4dcf-ae5d-c7d837b9d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:31.372635 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-579c89dc-fa3f-4dcf-ae5d-c7d837b9d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:31.380913 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-579c89dc-fa3f-4dcf-ae5d-c7d837b9d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.158763 Jun 07 13:19:31.381487 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 90/179] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:31 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:31.435181 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-edc08cf4-7390-4f1d-a32e-f20dc938b55e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:31.435834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-edc08cf4-7390-4f1d-a32e-f20dc938b55e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:31.441939 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-edc08cf4-7390-4f1d-a32e-f20dc938b55e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.443059 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-edc08cf4-7390-4f1d-a32e-f20dc938b55e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:31.443897 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-edc08cf4-7390-4f1d-a32e-f20dc938b55e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.444345 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-edc08cf4-7390-4f1d-a32e-f20dc938b55e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:31.508318 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-edc08cf4-7390-4f1d-a32e-f20dc938b55e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:31.515728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-edc08cf4-7390-4f1d-a32e-f20dc938b55e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1273 microversion: 2.1 time: 0.084378 Jun 07 13:19:31.516301 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 90/180] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:31 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:31.633547 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:31.634848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:31.642065 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.642368 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:31.643162 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.643624 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:31.720833 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:31.729666 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:31.734794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:31.736156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b7db2a56-efe7-40d2-be4f-11d2dd344146 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1277 microversion: 2.20 time: 0.111995 Jun 07 13:19:31.739125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 91/181] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:31 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:31.943607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-183a675b-d4d6-4e49-9d32-1437bb83522b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:31.944303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-183a675b-d4d6-4e49-9d32-1437bb83522b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:31.950176 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-183a675b-d4d6-4e49-9d32-1437bb83522b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.950623 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-183a675b-d4d6-4e49-9d32-1437bb83522b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:31.951409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-183a675b-d4d6-4e49-9d32-1437bb83522b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:31.951844 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-183a675b-d4d6-4e49-9d32-1437bb83522b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:32.013523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-183a675b-d4d6-4e49-9d32-1437bb83522b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:32.021792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-183a675b-d4d6-4e49-9d32-1437bb83522b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1267 microversion: 2.1 time: 0.082000 Jun 07 13:19:32.022382 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 91/182] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:31 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:32.399118 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0dadb97b-80e5-4af8-9c5b-01a45c140976 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:32.399829 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0dadb97b-80e5-4af8-9c5b-01a45c140976 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:32.406656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0dadb97b-80e5-4af8-9c5b-01a45c140976 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:32.407160 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0dadb97b-80e5-4af8-9c5b-01a45c140976 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:32.407919 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0dadb97b-80e5-4af8-9c5b-01a45c140976 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:32.408355 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0dadb97b-80e5-4af8-9c5b-01a45c140976 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:32.533732 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-446bebe4-1e78-4a83-9a64-def176b3dcac tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:32.534351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-446bebe4-1e78-4a83-9a64-def176b3dcac tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:32.542346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-446bebe4-1e78-4a83-9a64-def176b3dcac tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:32.542798 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-446bebe4-1e78-4a83-9a64-def176b3dcac tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:32.543592 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-446bebe4-1e78-4a83-9a64-def176b3dcac tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:32.544023 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-446bebe4-1e78-4a83-9a64-def176b3dcac tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:32.547320 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0dadb97b-80e5-4af8-9c5b-01a45c140976 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:32.555028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0dadb97b-80e5-4af8-9c5b-01a45c140976 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1521 microversion: 2.1 time: 0.160512 Jun 07 13:19:32.555629 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 92/183] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:32 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:32.686510 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-446bebe4-1e78-4a83-9a64-def176b3dcac tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:32.696032 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-446bebe4-1e78-4a83-9a64-def176b3dcac tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.166075 Jun 07 13:19:32.696712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 92/184] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:32 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:32.756404 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:32.756938 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:32.763039 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:32.763488 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:32.764246 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:32.764675 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:32.827124 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:32.834930 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:32.836428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:32.837527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-36ee56b3-28b7-4952-bd86-4410481a8fd6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1341 microversion: 2.20 time: 0.085753 Jun 07 13:19:32.838082 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 93/185] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:32 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:33.039235 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-39295d21-2de8-40c8-8e3c-c4935b46c946 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:33.039770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-39295d21-2de8-40c8-8e3c-c4935b46c946 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:33.045748 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39295d21-2de8-40c8-8e3c-c4935b46c946 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.046198 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39295d21-2de8-40c8-8e3c-c4935b46c946 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.046983 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39295d21-2de8-40c8-8e3c-c4935b46c946 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.047421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39295d21-2de8-40c8-8e3c-c4935b46c946 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.107885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-39295d21-2de8-40c8-8e3c-c4935b46c946 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:33.115727 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-39295d21-2de8-40c8-8e3c-c4935b46c946 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1267 microversion: 2.1 time: 0.080388 Jun 07 13:19:33.116298 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 93/186] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:33 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:33.572310 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e9e9e780-acd7-467e-85de-5161fbddf0ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:33.572919 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e9e9e780-acd7-467e-85de-5161fbddf0ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:33.579665 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e9e9e780-acd7-467e-85de-5161fbddf0ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.580115 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e9e9e780-acd7-467e-85de-5161fbddf0ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.580877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e9e9e780-acd7-467e-85de-5161fbddf0ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.581305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e9e9e780-acd7-467e-85de-5161fbddf0ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.715428 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7b8261de-982c-45d1-94b3-672d4627f819 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:33.716078 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e9e9e780-acd7-467e-85de-5161fbddf0ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:33.716268 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7b8261de-982c-45d1-94b3-672d4627f819 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:33.724464 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7b8261de-982c-45d1-94b3-672d4627f819 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.724918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7b8261de-982c-45d1-94b3-672d4627f819 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.725960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7b8261de-982c-45d1-94b3-672d4627f819 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.726413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7b8261de-982c-45d1-94b3-672d4627f819 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.738002 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e9e9e780-acd7-467e-85de-5161fbddf0ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1501 microversion: 2.1 time: 0.169446 Jun 07 13:19:33.739533 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 94/187] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:33 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:33.770265 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4f7b91eb-04aa-4b84-8d77-dc265c508d47 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:33.771742 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4f7b91eb-04aa-4b84-8d77-dc265c508d47 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:33.789512 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f7b91eb-04aa-4b84-8d77-dc265c508d47 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.790864 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f7b91eb-04aa-4b84-8d77-dc265c508d47 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.791873 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f7b91eb-04aa-4b84-8d77-dc265c508d47 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:33.792467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f7b91eb-04aa-4b84-8d77-dc265c508d47 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:33.987580 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7b8261de-982c-45d1-94b3-672d4627f819 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:33.996051 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7b8261de-982c-45d1-94b3-672d4627f819 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.285053 Jun 07 13:19:33.996625 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 94/188] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:33 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:34.002898 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:34.004147 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:34.010873 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:34.011555 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:34.012334 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:34.012771 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:34.024236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4f7b91eb-04aa-4b84-8d77-dc265c508d47 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:34.035790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4f7b91eb-04aa-4b84-8d77-dc265c508d47 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1515 microversion: 2.1 time: 0.285033 Jun 07 13:19:34.036719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 95/189] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:33 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1515 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:34.093948 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:34.103649 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:34.105336 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:34.106574 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-723afdaa-982c-437a-bfae-818e2d48b3fd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1339 microversion: 2.20 time: 0.108853 Jun 07 13:19:34.107590 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 95/190] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:33 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:34.133139 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-79684ede-38ae-4ad5-b517-07cc7d27eea6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:34.133671 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-79684ede-38ae-4ad5-b517-07cc7d27eea6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:34.140558 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-79684ede-38ae-4ad5-b517-07cc7d27eea6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:34.140823 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-79684ede-38ae-4ad5-b517-07cc7d27eea6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:34.141811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-79684ede-38ae-4ad5-b517-07cc7d27eea6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:34.142261 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-79684ede-38ae-4ad5-b517-07cc7d27eea6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:34.253002 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-79684ede-38ae-4ad5-b517-07cc7d27eea6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:34.265459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-79684ede-38ae-4ad5-b517-07cc7d27eea6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1285 microversion: 2.1 time: 0.136570 Jun 07 13:19:34.266368 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 96/191] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:34 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:34.719464 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-daffa92a-bf73-42a3-86f5-cb2ccc11b6c2 req-43949a0c-3033-49d3-b77e-11d355b1b729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9431594-ac28-4b88-bb34-c94ad9903743", "tag": "a4698c40-1169-449b-8114-06c3b5e1c430"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:34.730195 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-daffa92a-bf73-42a3-86f5-cb2ccc11b6c2 req-43949a0c-3033-49d3-b77e-11d355b1b729 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:34.730646 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-daffa92a-bf73-42a3-86f5-cb2ccc11b6c2 req-43949a0c-3033-49d3-b77e-11d355b1b729 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:34.742740 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-daffa92a-bf73-42a3-86f5-cb2ccc11b6c2 req-43949a0c-3033-49d3-b77e-11d355b1b729 service nova] Creating event network-changed:a4698c40-1169-449b-8114-06c3b5e1c430 for instance d9431594-ac28-4b88-bb34-c94ad9903743 on hv-cinder-84460 Jun 07 13:19:34.747772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-daffa92a-bf73-42a3-86f5-cb2ccc11b6c2 req-43949a0c-3033-49d3-b77e-11d355b1b729 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031971 Jun 07 13:19:34.748376 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 96/192] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:19:35.012801 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c51039ca-1b50-484d-9e40-21031d1eaae8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:35.013425 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c51039ca-1b50-484d-9e40-21031d1eaae8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:35.021774 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c51039ca-1b50-484d-9e40-21031d1eaae8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.022367 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c51039ca-1b50-484d-9e40-21031d1eaae8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.023261 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c51039ca-1b50-484d-9e40-21031d1eaae8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.023953 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c51039ca-1b50-484d-9e40-21031d1eaae8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.124540 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:35.125326 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:35.132523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.133065 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.133973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.134471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.188558 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c51039ca-1b50-484d-9e40-21031d1eaae8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:35.197951 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c51039ca-1b50-484d-9e40-21031d1eaae8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.188999 Jun 07 13:19:35.198674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 97/193] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:35 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:35.206605 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:35.214982 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:35.216481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:35.217589 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a17ffcb7-f380-454a-a920-5a3b74453fcf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1339 microversion: 2.20 time: 0.097398 Jun 07 13:19:35.218491 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 97/194] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:35 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:35.285330 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-85a6ffd8-4db5-429a-ab62-0502f1fb5966 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:35.285956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-85a6ffd8-4db5-429a-ab62-0502f1fb5966 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:35.292736 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-85a6ffd8-4db5-429a-ab62-0502f1fb5966 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.293457 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-85a6ffd8-4db5-429a-ab62-0502f1fb5966 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.294281 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-85a6ffd8-4db5-429a-ab62-0502f1fb5966 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.294713 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-85a6ffd8-4db5-429a-ab62-0502f1fb5966 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.358582 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-85a6ffd8-4db5-429a-ab62-0502f1fb5966 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:35.368609 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-85a6ffd8-4db5-429a-ab62-0502f1fb5966 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1273 microversion: 2.1 time: 0.088189 Jun 07 13:19:35.369962 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 98/195] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:35 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:35.477237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c8c5aea3-9391-4ce3-8577-3b451f8eb3bf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:35.478237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c8c5aea3-9391-4ce3-8577-3b451f8eb3bf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:35.484302 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c8c5aea3-9391-4ce3-8577-3b451f8eb3bf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.484933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c8c5aea3-9391-4ce3-8577-3b451f8eb3bf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.485693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c8c5aea3-9391-4ce3-8577-3b451f8eb3bf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.486128 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c8c5aea3-9391-4ce3-8577-3b451f8eb3bf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.511921 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-c8c5aea3-9391-4ce3-8577-3b451f8eb3bf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lazy-loading 'flavor' on Instance uuid 23bca688-1384-4f4d-a129-4129e290831c {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:19:35.625482 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c8c5aea3-9391-4ce3-8577-3b451f8eb3bf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c/action" status: 200 len: 32 microversion: 2.1 time: 0.153096 Jun 07 13:19:35.626446 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 98/196] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:19:35 2022] POST /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:19:35.636551 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ac13b882-23ac-49c3-ab64-6695b6e063f0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:35.637578 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ac13b882-23ac-49c3-ab64-6695b6e063f0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:35.645120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac13b882-23ac-49c3-ab64-6695b6e063f0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.645659 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac13b882-23ac-49c3-ab64-6695b6e063f0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.647386 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac13b882-23ac-49c3-ab64-6695b6e063f0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.647865 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac13b882-23ac-49c3-ab64-6695b6e063f0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.974931 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ac13b882-23ac-49c3-ab64-6695b6e063f0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:35.983296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ac13b882-23ac-49c3-ab64-6695b6e063f0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.351579 Jun 07 13:19:35.993730 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 99/197] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:35 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:36.227263 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8624eaae-9dda-47b7-b8fb-8e0443e48cb6 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:36.228870 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8624eaae-9dda-47b7-b8fb-8e0443e48cb6 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:36.238798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:36.239603 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:36.247268 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.247500 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8624eaae-9dda-47b7-b8fb-8e0443e48cb6 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.248063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.248648 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8624eaae-9dda-47b7-b8fb-8e0443e48cb6 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.249447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8624eaae-9dda-47b7-b8fb-8e0443e48cb6 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.249916 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8624eaae-9dda-47b7-b8fb-8e0443e48cb6 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.250436 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.251116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.502097 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:36.507687 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8624eaae-9dda-47b7-b8fb-8e0443e48cb6 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:36.519221 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8624eaae-9dda-47b7-b8fb-8e0443e48cb6 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.307205 Jun 07 13:19:36.522690 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:36.524454 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:36.525320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 99/198] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:36 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:36.537008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a0bf4d8c-9aae-4bce-bb39-e59c33c4ec46 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.304956 Jun 07 13:19:36.541171 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-94b7cab1-63d8-4928-b13d-647a182ad3ac tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:36.541739 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-94b7cab1-63d8-4928-b13d-647a182ad3ac tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:36.545465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 100/199] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:36 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:36.561980 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-94b7cab1-63d8-4928-b13d-647a182ad3ac tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.562424 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-94b7cab1-63d8-4928-b13d-647a182ad3ac tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.563264 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-94b7cab1-63d8-4928-b13d-647a182ad3ac tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.563725 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-94b7cab1-63d8-4928-b13d-647a182ad3ac tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.730284 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-94b7cab1-63d8-4928-b13d-647a182ad3ac tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:36.739421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-94b7cab1-63d8-4928-b13d-647a182ad3ac tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.203790 Jun 07 13:19:36.740569 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 100/200] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:36 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:37.001480 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-930ade09-8959-4d05-bb6f-c94152e8836a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.002357 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-930ade09-8959-4d05-bb6f-c94152e8836a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.006545 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-7e5de089-28f0-4ebb-a869-263b764c3dac req-02d45149-82a7-4bc6-823d-47d2698b4686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2d4bcb-ea81-4550-be2e-2689fffd0943", "tag": "4846c4cd-df7f-498e-a460-3a57b147fedb"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:37.010410 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-930ade09-8959-4d05-bb6f-c94152e8836a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.010933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-930ade09-8959-4d05-bb6f-c94152e8836a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.011704 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-930ade09-8959-4d05-bb6f-c94152e8836a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.012139 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-930ade09-8959-4d05-bb6f-c94152e8836a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.022245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-7e5de089-28f0-4ebb-a869-263b764c3dac req-02d45149-82a7-4bc6-823d-47d2698b4686 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.027992 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-7e5de089-28f0-4ebb-a869-263b764c3dac req-02d45149-82a7-4bc6-823d-47d2698b4686 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.045920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-7e5de089-28f0-4ebb-a869-263b764c3dac req-02d45149-82a7-4bc6-823d-47d2698b4686 service nova] Creating event network-changed:4846c4cd-df7f-498e-a460-3a57b147fedb for instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 on hv-cinder-84460 Jun 07 13:19:37.050880 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-7e5de089-28f0-4ebb-a869-263b764c3dac req-02d45149-82a7-4bc6-823d-47d2698b4686 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048648 Jun 07 13:19:37.051466 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 101/201] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:19:37.208539 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-930ade09-8959-4d05-bb6f-c94152e8836a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.216351 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-930ade09-8959-4d05-bb6f-c94152e8836a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.219032 Jun 07 13:19:37.216934 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 101/202] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:36 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:37.542976 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-394a73f9-01b6-458d-8961-a9dde8c19bbd tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.544236 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-394a73f9-01b6-458d-8961-a9dde8c19bbd tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.550943 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-394a73f9-01b6-458d-8961-a9dde8c19bbd tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.551606 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-394a73f9-01b6-458d-8961-a9dde8c19bbd tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.553073 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-394a73f9-01b6-458d-8961-a9dde8c19bbd tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.553506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-394a73f9-01b6-458d-8961-a9dde8c19bbd tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.565948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.567161 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.580844 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.581304 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.582086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.584438 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.813332 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-394a73f9-01b6-458d-8961-a9dde8c19bbd tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.826462 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-394a73f9-01b6-458d-8961-a9dde8c19bbd tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.287451 Jun 07 13:19:37.827400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.828318 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 102/203] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:37 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:37.835500 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8b8b1548-2f71-485d-8217-36de80168daa tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.836136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.836873 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8b8b1548-2f71-485d-8217-36de80168daa tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.837723 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.839155 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2398c87e-9d48-4ba0-9201-3c8cbc4cc87e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.277583 Jun 07 13:19:37.850394 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 102/204] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:37 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:37.850583 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8b8b1548-2f71-485d-8217-36de80168daa tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.850583 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8b8b1548-2f71-485d-8217-36de80168daa tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.851079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8b8b1548-2f71-485d-8217-36de80168daa tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.851792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8b8b1548-2f71-485d-8217-36de80168daa tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.069518 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8b8b1548-2f71-485d-8217-36de80168daa tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:38.081472 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8b8b1548-2f71-485d-8217-36de80168daa tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.250757 Jun 07 13:19:38.091215 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 103/205] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:37 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:38.233497 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c365d14d-3eda-4de6-a2ae-12a5094b6e29 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:38.234277 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c365d14d-3eda-4de6-a2ae-12a5094b6e29 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:38.241304 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c365d14d-3eda-4de6-a2ae-12a5094b6e29 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.241879 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c365d14d-3eda-4de6-a2ae-12a5094b6e29 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.242908 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c365d14d-3eda-4de6-a2ae-12a5094b6e29 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.243584 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c365d14d-3eda-4de6-a2ae-12a5094b6e29 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.421280 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c365d14d-3eda-4de6-a2ae-12a5094b6e29 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:38.437928 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c365d14d-3eda-4de6-a2ae-12a5094b6e29 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.207435 Jun 07 13:19:38.438545 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 103/206] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:38 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:38.844261 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-16040cc9-a803-456b-abc3-afb11c6be46e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:38.844697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-16040cc9-a803-456b-abc3-afb11c6be46e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:38.851103 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-16040cc9-a803-456b-abc3-afb11c6be46e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.851721 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-16040cc9-a803-456b-abc3-afb11c6be46e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.852887 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-16040cc9-a803-456b-abc3-afb11c6be46e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.853330 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-16040cc9-a803-456b-abc3-afb11c6be46e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.857243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:38.857852 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:38.864144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.864573 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.865331 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.865921 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.884164 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=100 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:39.060551 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-16040cc9-a803-456b-abc3-afb11c6be46e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:39.061927 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:39.069621 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-16040cc9-a803-456b-abc3-afb11c6be46e tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.229903 Jun 07 13:19:39.070801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 104/207] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:38 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:39.072739 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:39.074252 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:39.075411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-557b31f8-f1b9-4f77-86e5-dd7b275254f5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.222032 Jun 07 13:19:39.077624 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-e4a86708-9736-40c2-8d3a-9b3bb85f8887 req-c3273abe-8668-46e9-a41f-f617c4dcd6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edff24ec-db4a-4fe9-b564-9dabd56acf8e", "tag": "bcd3488e-becb-41b9-ad34-acd79eb0dd17"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:39.080144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 104/208] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:38 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:39.087373 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-e4a86708-9736-40c2-8d3a-9b3bb85f8887 req-c3273abe-8668-46e9-a41f-f617c4dcd6cd service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.087887 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-e4a86708-9736-40c2-8d3a-9b3bb85f8887 req-c3273abe-8668-46e9-a41f-f617c4dcd6cd service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.099482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d5bb768a-e968-42f8-b4fc-3c26af1acd85 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:39.100095 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d5bb768a-e968-42f8-b4fc-3c26af1acd85 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:39.110380 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d5bb768a-e968-42f8-b4fc-3c26af1acd85 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.110587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d5bb768a-e968-42f8-b4fc-3c26af1acd85 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.110812 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-e4a86708-9736-40c2-8d3a-9b3bb85f8887 req-c3273abe-8668-46e9-a41f-f617c4dcd6cd service nova] Creating event network-changed:bcd3488e-becb-41b9-ad34-acd79eb0dd17 for instance edff24ec-db4a-4fe9-b564-9dabd56acf8e on hv-cinder-84460 Jun 07 13:19:39.111397 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d5bb768a-e968-42f8-b4fc-3c26af1acd85 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.111827 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d5bb768a-e968-42f8-b4fc-3c26af1acd85 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.116706 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-e4a86708-9736-40c2-8d3a-9b3bb85f8887 req-c3273abe-8668-46e9-a41f-f617c4dcd6cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043910 Jun 07 13:19:39.117311 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 105/209] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:39.246977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d5bb768a-e968-42f8-b4fc-3c26af1acd85 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:39.254944 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d5bb768a-e968-42f8-b4fc-3c26af1acd85 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.159927 Jun 07 13:19:39.255562 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 105/210] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:39 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:39.455815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b7230ed5-dfb7-4f62-a541-956487aea999 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:39.456821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b7230ed5-dfb7-4f62-a541-956487aea999 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:39.480286 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b7230ed5-dfb7-4f62-a541-956487aea999 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.483413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b7230ed5-dfb7-4f62-a541-956487aea999 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.484463 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b7230ed5-dfb7-4f62-a541-956487aea999 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.487252 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b7230ed5-dfb7-4f62-a541-956487aea999 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.501880 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:39.673293 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b7230ed5-dfb7-4f62-a541-956487aea999 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:39.683375 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b7230ed5-dfb7-4f62-a541-956487aea999 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.231878 Jun 07 13:19:39.685085 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 106/211] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:39 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:40.087515 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-85f9019b-70bf-44c3-b4f0-eb29e4f83a87 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:40.090169 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-85f9019b-70bf-44c3-b4f0-eb29e4f83a87 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:40.095480 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:40.095955 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-85f9019b-70bf-44c3-b4f0-eb29e4f83a87 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.096081 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-85f9019b-70bf-44c3-b4f0-eb29e4f83a87 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.096784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-85f9019b-70bf-44c3-b4f0-eb29e4f83a87 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.096992 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:40.097214 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-85f9019b-70bf-44c3-b4f0-eb29e4f83a87 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.103761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.104538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.105521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.106187 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.185399 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:40.324925 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-85f9019b-70bf-44c3-b4f0-eb29e4f83a87 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:40.330641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:40.334133 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-85f9019b-70bf-44c3-b4f0-eb29e4f83a87 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.251017 Jun 07 13:19:40.334727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 106/212] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:40 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:40.339390 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-300082e0-7737-44f5-981d-17823a8b88a9 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:40.340173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-300082e0-7737-44f5-981d-17823a8b88a9 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:40.344751 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:40.346350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:40.347298 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-300082e0-7737-44f5-981d-17823a8b88a9 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.347954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6b4b026a-666e-474b-8420-025ed7357f99 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.255985 Jun 07 13:19:40.348062 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-300082e0-7737-44f5-981d-17823a8b88a9 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.350882 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 107/213] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:40 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:40.351007 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-300082e0-7737-44f5-981d-17823a8b88a9 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.351007 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-300082e0-7737-44f5-981d-17823a8b88a9 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.482912 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-300082e0-7737-44f5-981d-17823a8b88a9 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:40.490661 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-300082e0-7737-44f5-981d-17823a8b88a9 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.154923 Jun 07 13:19:40.491351 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 107/214] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:40 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:40.701490 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-93109664-a743-4776-bb0b-9d3c2f360750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:40.702451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-93109664-a743-4776-bb0b-9d3c2f360750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:40.709064 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-93109664-a743-4776-bb0b-9d3c2f360750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.709516 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-93109664-a743-4776-bb0b-9d3c2f360750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.710278 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-93109664-a743-4776-bb0b-9d3c2f360750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.710713 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-93109664-a743-4776-bb0b-9d3c2f360750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.848430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-93109664-a743-4776-bb0b-9d3c2f360750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:40.855972 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-93109664-a743-4776-bb0b-9d3c2f360750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.158685 Jun 07 13:19:40.856540 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 108/215] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:40 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:41.351838 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5af3a301-ad63-4df2-8697-e3faea331948 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:41.352461 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5af3a301-ad63-4df2-8697-e3faea331948 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:41.354346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=4 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:41.355149 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=12 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:41.361697 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5af3a301-ad63-4df2-8697-e3faea331948 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.362152 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5af3a301-ad63-4df2-8697-e3faea331948 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.362964 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5af3a301-ad63-4df2-8697-e3faea331948 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.363406 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5af3a301-ad63-4df2-8697-e3faea331948 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.365926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:41.366549 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:41.368411 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=12 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:41.373692 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.374146 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.374938 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.375376 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.551161 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5af3a301-ad63-4df2-8697-e3faea331948 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:41.558774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:41.559133 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5af3a301-ad63-4df2-8697-e3faea331948 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.211900 Jun 07 13:19:41.559715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 108/216] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:41 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:41.564088 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-59fa8a20-1cf0-4c72-9ff1-1decc58e2d1d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:41.564684 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-59fa8a20-1cf0-4c72-9ff1-1decc58e2d1d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:41.567253 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:41.568856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:41.569975 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4aac3e9c-1a25-48ec-8f30-a328a427a903 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.208416 Jun 07 13:19:41.570658 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 109/217] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:41 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:41.570794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-59fa8a20-1cf0-4c72-9ff1-1decc58e2d1d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.571326 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-59fa8a20-1cf0-4c72-9ff1-1decc58e2d1d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.572079 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-59fa8a20-1cf0-4c72-9ff1-1decc58e2d1d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.572511 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-59fa8a20-1cf0-4c72-9ff1-1decc58e2d1d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.698727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-59fa8a20-1cf0-4c72-9ff1-1decc58e2d1d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:41.706028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-59fa8a20-1cf0-4c72-9ff1-1decc58e2d1d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.145369 Jun 07 13:19:41.706624 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 109/218] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:41 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:41.872221 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f4bc5020-05ea-476c-a695-e8c63ceac671 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:41.872831 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f4bc5020-05ea-476c-a695-e8c63ceac671 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:41.878724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4bc5020-05ea-476c-a695-e8c63ceac671 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.879201 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4bc5020-05ea-476c-a695-e8c63ceac671 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.879957 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4bc5020-05ea-476c-a695-e8c63ceac671 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.880426 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4bc5020-05ea-476c-a695-e8c63ceac671 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.004391 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f4bc5020-05ea-476c-a695-e8c63ceac671 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.011780 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f4bc5020-05ea-476c-a695-e8c63ceac671 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.143322 Jun 07 13:19:42.012342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 110/219] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:41 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:42.575871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0af2fb20-acd4-489e-8bda-f4cbf6d338cc tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:42.576491 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0af2fb20-acd4-489e-8bda-f4cbf6d338cc tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:42.582995 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0af2fb20-acd4-489e-8bda-f4cbf6d338cc tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.583445 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0af2fb20-acd4-489e-8bda-f4cbf6d338cc tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.584209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0af2fb20-acd4-489e-8bda-f4cbf6d338cc tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.584644 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0af2fb20-acd4-489e-8bda-f4cbf6d338cc tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.587163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:42.587778 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:42.593706 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.594157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.595021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.595459 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.769368 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0af2fb20-acd4-489e-8bda-f4cbf6d338cc tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.775841 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.776978 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0af2fb20-acd4-489e-8bda-f4cbf6d338cc tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.204950 Jun 07 13:19:42.777562 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 110/220] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:42 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:42.782905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cc7cc8cb-72ac-45d2-bf98-50ec6d83e136 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:42.783516 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cc7cc8cb-72ac-45d2-bf98-50ec6d83e136 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:42.783740 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.785248 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.786355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5984c417-eae9-4a9d-8917-ab28b93f3f3e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.203036 Jun 07 13:19:42.787038 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 111/221] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:42 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:42.789544 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cc7cc8cb-72ac-45d2-bf98-50ec6d83e136 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.789990 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cc7cc8cb-72ac-45d2-bf98-50ec6d83e136 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.790754 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cc7cc8cb-72ac-45d2-bf98-50ec6d83e136 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:42.791216 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cc7cc8cb-72ac-45d2-bf98-50ec6d83e136 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.921227 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-cc7cc8cb-72ac-45d2-bf98-50ec6d83e136 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.929293 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cc7cc8cb-72ac-45d2-bf98-50ec6d83e136 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.150547 Jun 07 13:19:42.929865 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 111/222] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:42 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:43.029113 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fd2710c4-aa7d-4925-87a5-9fc8edeba17c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:43.029825 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fd2710c4-aa7d-4925-87a5-9fc8edeba17c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:43.035876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd2710c4-aa7d-4925-87a5-9fc8edeba17c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.036892 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd2710c4-aa7d-4925-87a5-9fc8edeba17c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.037715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd2710c4-aa7d-4925-87a5-9fc8edeba17c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.038269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd2710c4-aa7d-4925-87a5-9fc8edeba17c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.088937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-b71e0ec9-b326-40f5-9039-d8e426bd8e58 req-a18528a9-bd1b-4f3d-803a-0bb563cbe548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9431594-ac28-4b88-bb34-c94ad9903743", "name": "network-vif-plugged", "status": "completed", "tag": "a4698c40-1169-449b-8114-06c3b5e1c430"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:43.098459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-b71e0ec9-b326-40f5-9039-d8e426bd8e58 req-a18528a9-bd1b-4f3d-803a-0bb563cbe548 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.099427 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-b71e0ec9-b326-40f5-9039-d8e426bd8e58 req-a18528a9-bd1b-4f3d-803a-0bb563cbe548 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.113236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-b71e0ec9-b326-40f5-9039-d8e426bd8e58 req-a18528a9-bd1b-4f3d-803a-0bb563cbe548 service nova] Creating event network-vif-plugged:a4698c40-1169-449b-8114-06c3b5e1c430 for instance d9431594-ac28-4b88-bb34-c94ad9903743 on hv-cinder-84460 Jun 07 13:19:43.119030 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-b71e0ec9-b326-40f5-9039-d8e426bd8e58 req-a18528a9-bd1b-4f3d-803a-0bb563cbe548 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033825 Jun 07 13:19:43.119636 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 112/223] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:19:43.169448 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fd2710c4-aa7d-4925-87a5-9fc8edeba17c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:43.177563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fd2710c4-aa7d-4925-87a5-9fc8edeba17c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.151726 Jun 07 13:19:43.178124 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 112/224] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:43 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:43.794398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-60777e45-7be1-4456-ac14-cde50f816538 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:43.795138 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-60777e45-7be1-4456-ac14-cde50f816538 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:43.801587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-60777e45-7be1-4456-ac14-cde50f816538 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.802722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-60777e45-7be1-4456-ac14-cde50f816538 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.803525 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-60777e45-7be1-4456-ac14-cde50f816538 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.803689 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:43.804109 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-60777e45-7be1-4456-ac14-cde50f816538 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.804335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:43.810372 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.810821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.811604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.812038 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.993584 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-60777e45-7be1-4456-ac14-cde50f816538 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.000550 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.001075 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-60777e45-7be1-4456-ac14-cde50f816538 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.211368 Jun 07 13:19:44.001667 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 113/225] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:43 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:44.006116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a52516af-f8ee-4706-8ff9-7456c0e96598 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:44.006729 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a52516af-f8ee-4706-8ff9-7456c0e96598 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:44.009046 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.010612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.011754 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6f1e0799-c4a4-4b9f-8e7a-fb05d99d517d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.212609 Jun 07 13:19:44.012377 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 113/226] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:43 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:44.012671 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a52516af-f8ee-4706-8ff9-7456c0e96598 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.013134 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a52516af-f8ee-4706-8ff9-7456c0e96598 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.013913 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a52516af-f8ee-4706-8ff9-7456c0e96598 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.014352 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a52516af-f8ee-4706-8ff9-7456c0e96598 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.138646 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a52516af-f8ee-4706-8ff9-7456c0e96598 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.146612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a52516af-f8ee-4706-8ff9-7456c0e96598 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.143998 Jun 07 13:19:44.147216 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 114/227] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:44 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:44.194454 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0485088e-8efb-47c3-8ba2-3bec598215ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:44.195159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0485088e-8efb-47c3-8ba2-3bec598215ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:44.201095 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0485088e-8efb-47c3-8ba2-3bec598215ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.201542 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0485088e-8efb-47c3-8ba2-3bec598215ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.202320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0485088e-8efb-47c3-8ba2-3bec598215ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.202754 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0485088e-8efb-47c3-8ba2-3bec598215ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.332382 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0485088e-8efb-47c3-8ba2-3bec598215ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.340371 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0485088e-8efb-47c3-8ba2-3bec598215ed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.149647 Jun 07 13:19:44.340943 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 114/228] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:44 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:44.993397 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d156ff5a-2fc6-4d3b-a073-fad95013def3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:44.994061 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d156ff5a-2fc6-4d3b-a073-fad95013def3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.005877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d156ff5a-2fc6-4d3b-a073-fad95013def3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.006540 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d156ff5a-2fc6-4d3b-a073-fad95013def3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.007512 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d156ff5a-2fc6-4d3b-a073-fad95013def3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.008104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d156ff5a-2fc6-4d3b-a073-fad95013def3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.017895 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-de4b4626-611d-4d41-8d59-0aa6c9458d15 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.019892 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-de4b4626-611d-4d41-8d59-0aa6c9458d15 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.026466 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-de4b4626-611d-4d41-8d59-0aa6c9458d15 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.026976 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-de4b4626-611d-4d41-8d59-0aa6c9458d15 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.027749 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-de4b4626-611d-4d41-8d59-0aa6c9458d15 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.028178 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-de4b4626-611d-4d41-8d59-0aa6c9458d15 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.064077 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d156ff5a-2fc6-4d3b-a073-fad95013def3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/ips" status: 200 len: 150 microversion: 2.1 time: 0.075036 Jun 07 13:19:45.064863 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 115/229] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:19:44 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/ips => generated 150 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:45.069977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.070580 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.077398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.078105 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.079063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.079657 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.268952 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-de4b4626-611d-4d41-8d59-0aa6c9458d15 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.279291 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-de4b4626-611d-4d41-8d59-0aa6c9458d15 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.265530 Jun 07 13:19:45.280526 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 115/230] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:45.284486 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.285522 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e039151f-253a-41ac-9c1b-433ea43b89b0 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.287266 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e039151f-253a-41ac-9c1b-433ea43b89b0 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.294308 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.295058 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e039151f-253a-41ac-9c1b-433ea43b89b0 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.295675 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e039151f-253a-41ac-9c1b-433ea43b89b0 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.295843 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.296870 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e039151f-253a-41ac-9c1b-433ea43b89b0 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.296986 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-744709d6-4a25-427e-8825-cf44389f86dc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.231176 Jun 07 13:19:45.297504 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 116/231] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:45.297700 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e039151f-253a-41ac-9c1b-433ea43b89b0 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.358600 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6f9d6f7d-5cb9-4155-b828-a5d5943ef7db tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.359926 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6f9d6f7d-5cb9-4155-b828-a5d5943ef7db tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.367093 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6f9d6f7d-5cb9-4155-b828-a5d5943ef7db tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.367451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6f9d6f7d-5cb9-4155-b828-a5d5943ef7db tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.368356 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6f9d6f7d-5cb9-4155-b828-a5d5943ef7db tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.368972 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6f9d6f7d-5cb9-4155-b828-a5d5943ef7db tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.516000 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e039151f-253a-41ac-9c1b-433ea43b89b0 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.524371 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e039151f-253a-41ac-9c1b-433ea43b89b0 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.242595 Jun 07 13:19:45.524963 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 116/232] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:45.562817 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6f9d6f7d-5cb9-4155-b828-a5d5943ef7db tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.570234 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6f9d6f7d-5cb9-4155-b828-a5d5943ef7db tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.216339 Jun 07 13:19:45.570916 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 117/233] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:46.297057 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-de94f8fe-5156-42bc-9cc8-633c8d73eee5 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:46.297672 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-de94f8fe-5156-42bc-9cc8-633c8d73eee5 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:46.304319 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-de94f8fe-5156-42bc-9cc8-633c8d73eee5 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.304769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-de94f8fe-5156-42bc-9cc8-633c8d73eee5 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.305600 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-de94f8fe-5156-42bc-9cc8-633c8d73eee5 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.305964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-de94f8fe-5156-42bc-9cc8-633c8d73eee5 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.315713 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:46.316250 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:46.323078 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.323593 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.324327 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.324763 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.504465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-de94f8fe-5156-42bc-9cc8-633c8d73eee5 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:46.511821 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:46.512807 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-de94f8fe-5156-42bc-9cc8-633c8d73eee5 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.219623 Jun 07 13:19:46.513394 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 117/234] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:46 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:46.519831 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:46.521730 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:46.523452 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ec5177a0-6974-4b3d-9da1-0efbee5935fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.211413 Jun 07 13:19:46.524118 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 118/235] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:46 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:46.541148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7fc2c246-35b6-42a4-85dd-e1493944adda tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:46.541774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7fc2c246-35b6-42a4-85dd-e1493944adda tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:46.547898 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7fc2c246-35b6-42a4-85dd-e1493944adda tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.548357 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7fc2c246-35b6-42a4-85dd-e1493944adda tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.549137 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7fc2c246-35b6-42a4-85dd-e1493944adda tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.549920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7fc2c246-35b6-42a4-85dd-e1493944adda tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.587277 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8fa8cada-5fdc-4883-b440-b7ce21262df8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:46.587917 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8fa8cada-5fdc-4883-b440-b7ce21262df8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:46.594239 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8fa8cada-5fdc-4883-b440-b7ce21262df8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.594774 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8fa8cada-5fdc-4883-b440-b7ce21262df8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.595638 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8fa8cada-5fdc-4883-b440-b7ce21262df8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.596071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8fa8cada-5fdc-4883-b440-b7ce21262df8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.730735 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7fc2c246-35b6-42a4-85dd-e1493944adda tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:46.738099 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7fc2c246-35b6-42a4-85dd-e1493944adda tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.200788 Jun 07 13:19:46.738665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 118/236] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:46 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:46.759796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8fa8cada-5fdc-4883-b440-b7ce21262df8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:46.767614 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8fa8cada-5fdc-4883-b440-b7ce21262df8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.184171 Jun 07 13:19:46.768272 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 119/237] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:46 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:47.529351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0232234c-8c32-4faf-9db2-306a4475485d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.529971 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0232234c-8c32-4faf-9db2-306a4475485d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.536516 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0232234c-8c32-4faf-9db2-306a4475485d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.537295 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0232234c-8c32-4faf-9db2-306a4475485d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.538106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0232234c-8c32-4faf-9db2-306a4475485d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.538552 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0232234c-8c32-4faf-9db2-306a4475485d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.540539 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.541158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.547700 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.548138 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.548900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.549333 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.726455 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0232234c-8c32-4faf-9db2-306a4475485d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:47.730367 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:47.734097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0232234c-8c32-4faf-9db2-306a4475485d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.208584 Jun 07 13:19:47.734862 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 119/238] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:47 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:47.738272 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:47.740295 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:47.741396 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b643ca74-d616-467f-8789-c4a98f50a3cd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.204810 Jun 07 13:19:47.741943 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 120/239] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:47 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:47.754189 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-87d5c1e1-74d9-4a5c-9d1d-d7fbfe3eb530 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.754822 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-87d5c1e1-74d9-4a5c-9d1d-d7fbfe3eb530 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.761341 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-87d5c1e1-74d9-4a5c-9d1d-d7fbfe3eb530 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.761791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-87d5c1e1-74d9-4a5c-9d1d-d7fbfe3eb530 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.762543 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-87d5c1e1-74d9-4a5c-9d1d-d7fbfe3eb530 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.763003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-87d5c1e1-74d9-4a5c-9d1d-d7fbfe3eb530 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.784323 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a181712a-76df-4560-b487-4fab0d7fc972 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.784937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a181712a-76df-4560-b487-4fab0d7fc972 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.790971 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a181712a-76df-4560-b487-4fab0d7fc972 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.791431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a181712a-76df-4560-b487-4fab0d7fc972 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.792195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a181712a-76df-4560-b487-4fab0d7fc972 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.792629 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a181712a-76df-4560-b487-4fab0d7fc972 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.956465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-87d5c1e1-74d9-4a5c-9d1d-d7fbfe3eb530 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:47.964181 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-87d5c1e1-74d9-4a5c-9d1d-d7fbfe3eb530 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.213605 Jun 07 13:19:47.964756 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 120/240] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:47 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:47.980562 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a181712a-76df-4560-b487-4fab0d7fc972 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:47.988033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a181712a-76df-4560-b487-4fab0d7fc972 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.207583 Jun 07 13:19:47.988716 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 121/241] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:47 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:48.751560 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7e132aeb-7e99-4cc2-aeff-6e195478e990 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:48.752227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7e132aeb-7e99-4cc2-aeff-6e195478e990 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:48.758877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:48.759545 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:48.767065 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:48.767529 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:48.768303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:48.768739 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:48.773352 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=100 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:48.777761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e132aeb-7e99-4cc2-aeff-6e195478e990 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:48.778161 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e132aeb-7e99-4cc2-aeff-6e195478e990 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:48.779010 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e132aeb-7e99-4cc2-aeff-6e195478e990 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:48.779452 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e132aeb-7e99-4cc2-aeff-6e195478e990 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:48.984702 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7e132aeb-7e99-4cc2-aeff-6e195478e990 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:48.987546 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:48.992205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7e132aeb-7e99-4cc2-aeff-6e195478e990 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.244582 Jun 07 13:19:48.992771 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 121/242] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:48 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:48.997617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:48.997617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:48.998058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-94966c6c-5d7b-4a5e-b447-c02483094939 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.243054 Jun 07 13:19:48.998867 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 122/243] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:48 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:49.001654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-a147b4e3-2949-46ce-805f-8f45f177f6f5 req-f0bbc155-241d-4a4f-bb79-81f22470b21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2d4bcb-ea81-4550-be2e-2689fffd0943", "name": "network-vif-plugged", "status": "completed", "tag": "4846c4cd-df7f-498e-a460-3a57b147fedb"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:49.003438 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-08dab293-c345-4019-9bea-aa9ae1a1d609 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:49.004040 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-08dab293-c345-4019-9bea-aa9ae1a1d609 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:49.010323 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-08dab293-c345-4019-9bea-aa9ae1a1d609 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.010509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-a147b4e3-2949-46ce-805f-8f45f177f6f5 req-f0bbc155-241d-4a4f-bb79-81f22470b21b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.010771 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-08dab293-c345-4019-9bea-aa9ae1a1d609 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.011309 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-a147b4e3-2949-46ce-805f-8f45f177f6f5 req-f0bbc155-241d-4a4f-bb79-81f22470b21b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.011550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-08dab293-c345-4019-9bea-aa9ae1a1d609 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.011980 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-08dab293-c345-4019-9bea-aa9ae1a1d609 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.023121 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-a147b4e3-2949-46ce-805f-8f45f177f6f5 req-f0bbc155-241d-4a4f-bb79-81f22470b21b service nova] Creating event network-vif-plugged:4846c4cd-df7f-498e-a460-3a57b147fedb for instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 on hv-cinder-84460 Jun 07 13:19:49.028549 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-a147b4e3-2949-46ce-805f-8f45f177f6f5 req-f0bbc155-241d-4a4f-bb79-81f22470b21b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031123 Jun 07 13:19:49.029215 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 122/244] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:49.034165 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9bfc0245-4426-4e37-b1a6-29c8916c1993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:49.034877 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9bfc0245-4426-4e37-b1a6-29c8916c1993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:49.040896 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9bfc0245-4426-4e37-b1a6-29c8916c1993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.041344 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9bfc0245-4426-4e37-b1a6-29c8916c1993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.042101 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9bfc0245-4426-4e37-b1a6-29c8916c1993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.042556 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9bfc0245-4426-4e37-b1a6-29c8916c1993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.060659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=100 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:49.208761 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-08dab293-c345-4019-9bea-aa9ae1a1d609 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:49.216410 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-08dab293-c345-4019-9bea-aa9ae1a1d609 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.216377 Jun 07 13:19:49.217124 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 123/245] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:48 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:49.231273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9bfc0245-4426-4e37-b1a6-29c8916c1993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:49.239858 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9bfc0245-4426-4e37-b1a6-29c8916c1993 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.209517 Jun 07 13:19:49.240413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 123/246] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:49 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:49.640547 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-09cfb498-62f9-495e-9d7a-e6d45d91a78a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7105f9d-8adb-4d59-8489-e37adcfa31c9"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:49.641679 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-09cfb498-62f9-495e-9d7a-e6d45d91a78a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:49.643544 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:49.649390 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-09cfb498-62f9-495e-9d7a-e6d45d91a78a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.649846 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-09cfb498-62f9-495e-9d7a-e6d45d91a78a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.650586 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-09cfb498-62f9-495e-9d7a-e6d45d91a78a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.651041 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-09cfb498-62f9-495e-9d7a-e6d45d91a78a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.017227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a50109c5-f97d-4d1a-b7f0-615d5ffcb860 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:50.017938 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a50109c5-f97d-4d1a-b7f0-615d5ffcb860 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:50.023935 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a50109c5-f97d-4d1a-b7f0-615d5ffcb860 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.024381 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a50109c5-f97d-4d1a-b7f0-615d5ffcb860 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.025133 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a50109c5-f97d-4d1a-b7f0-615d5ffcb860 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.025566 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a50109c5-f97d-4d1a-b7f0-615d5ffcb860 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.151526 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a50109c5-f97d-4d1a-b7f0-615d5ffcb860 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.158930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a50109c5-f97d-4d1a-b7f0-615d5ffcb860 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.145422 Jun 07 13:19:50.159445 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 124/247] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:50 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:50.163858 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:50.164528 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:50.169997 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.170451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.171246 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.171681 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.300351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.309128 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.310628 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.311753 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b5041093-b0c5-4a25-a735-b790eb871fe6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.151406 Jun 07 13:19:50.312311 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 125/248] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:50 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:50.316711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d425e81e-73c0-45b4-957c-1dd50c1712df tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:50.317415 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d425e81e-73c0-45b4-957c-1dd50c1712df tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:50.323233 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d425e81e-73c0-45b4-957c-1dd50c1712df tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.323677 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d425e81e-73c0-45b4-957c-1dd50c1712df tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.324436 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d425e81e-73c0-45b4-957c-1dd50c1712df tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.324867 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d425e81e-73c0-45b4-957c-1dd50c1712df tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.453478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d425e81e-73c0-45b4-957c-1dd50c1712df tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.460968 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d425e81e-73c0-45b4-957c-1dd50c1712df tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.147730 Jun 07 13:19:50.461535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 126/249] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:50 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:50.465824 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-dd20a3eb-ef18-4af4-874b-3c9e9053b9fa tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:50.466428 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-dd20a3eb-ef18-4af4-874b-3c9e9053b9fa tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:50.467987 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:50.473387 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd20a3eb-ef18-4af4-874b-3c9e9053b9fa tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.473840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd20a3eb-ef18-4af4-874b-3c9e9053b9fa tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.474599 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd20a3eb-ef18-4af4-874b-3c9e9053b9fa tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.475639 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd20a3eb-ef18-4af4-874b-3c9e9053b9fa tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.599479 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-dd20a3eb-ef18-4af4-874b-3c9e9053b9fa tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.607567 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-dd20a3eb-ef18-4af4-874b-3c9e9053b9fa tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.145097 Jun 07 13:19:50.608140 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 127/250] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:50 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:51.175302 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-82c1bf91-67d4-4ceb-a1bc-62955942d83a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:51.175910 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-82c1bf91-67d4-4ceb-a1bc-62955942d83a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:51.181899 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-82c1bf91-67d4-4ceb-a1bc-62955942d83a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.182348 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-82c1bf91-67d4-4ceb-a1bc-62955942d83a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.183136 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-82c1bf91-67d4-4ceb-a1bc-62955942d83a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.183568 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-82c1bf91-67d4-4ceb-a1bc-62955942d83a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.317170 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-82c1bf91-67d4-4ceb-a1bc-62955942d83a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:51.325215 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-82c1bf91-67d4-4ceb-a1bc-62955942d83a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.153765 Jun 07 13:19:51.325787 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 128/251] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:51 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:51.330243 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:51.330851 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:51.337116 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.337562 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.338312 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.338744 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.465851 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:51.474142 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:51.476315 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:51.477429 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-af45ec6c-1869-4050-b01a-d334ae96fa47 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.150730 Jun 07 13:19:51.477987 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 129/252] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:51 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:51.482304 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9708ec0b-b9aa-4ac1-9e2f-7f27a2eca417 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:51.482933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9708ec0b-b9aa-4ac1-9e2f-7f27a2eca417 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:51.488691 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9708ec0b-b9aa-4ac1-9e2f-7f27a2eca417 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.489144 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9708ec0b-b9aa-4ac1-9e2f-7f27a2eca417 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.489899 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9708ec0b-b9aa-4ac1-9e2f-7f27a2eca417 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.490335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9708ec0b-b9aa-4ac1-9e2f-7f27a2eca417 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.613226 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9708ec0b-b9aa-4ac1-9e2f-7f27a2eca417 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:51.620740 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9708ec0b-b9aa-4ac1-9e2f-7f27a2eca417 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.141762 Jun 07 13:19:51.621317 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 130/253] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:51 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:51.625677 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-191e1312-5f4e-43fd-b919-7c5e64e65235 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:51.626289 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-191e1312-5f4e-43fd-b919-7c5e64e65235 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:51.631860 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-191e1312-5f4e-43fd-b919-7c5e64e65235 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.632315 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-191e1312-5f4e-43fd-b919-7c5e64e65235 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.633081 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-191e1312-5f4e-43fd-b919-7c5e64e65235 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.633525 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-191e1312-5f4e-43fd-b919-7c5e64e65235 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.759505 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-191e1312-5f4e-43fd-b919-7c5e64e65235 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:51.766959 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-191e1312-5f4e-43fd-b919-7c5e64e65235 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.144677 Jun 07 13:19:51.767525 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 131/254] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:51 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:52.213508 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-09cfb498-62f9-495e-9d7a-e6d45d91a78a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.576688 Jun 07 13:19:52.214285 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 124/255] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:19:49 2022] POST /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments => generated 194 bytes in 2578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:52.341597 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-65de7369-d367-483e-93b7-c5d66e4146e8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:52.342800 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-65de7369-d367-483e-93b7-c5d66e4146e8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:52.349566 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65de7369-d367-483e-93b7-c5d66e4146e8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.350093 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65de7369-d367-483e-93b7-c5d66e4146e8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.350966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65de7369-d367-483e-93b7-c5d66e4146e8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.351492 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65de7369-d367-483e-93b7-c5d66e4146e8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.481415 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-65de7369-d367-483e-93b7-c5d66e4146e8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:52.490170 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-65de7369-d367-483e-93b7-c5d66e4146e8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1313 microversion: 2.1 time: 0.152311 Jun 07 13:19:52.491445 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 132/256] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:52 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:52.500299 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:52.501033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:52.508654 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.509193 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.510024 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.510468 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.637375 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9eb2ed0d-bd27-4f14-b96f-de8a40ee374a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:52.638017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9eb2ed0d-bd27-4f14-b96f-de8a40ee374a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:52.644051 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9eb2ed0d-bd27-4f14-b96f-de8a40ee374a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.644500 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9eb2ed0d-bd27-4f14-b96f-de8a40ee374a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.645268 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9eb2ed0d-bd27-4f14-b96f-de8a40ee374a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.645701 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9eb2ed0d-bd27-4f14-b96f-de8a40ee374a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.647581 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:52.655513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:52.657016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:52.658126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a1e920e5-6d45-4131-9211-7a0b8eedc0be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.162131 Jun 07 13:19:52.658688 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 125/257] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:52 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:19:52.769080 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9eb2ed0d-bd27-4f14-b96f-de8a40ee374a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:52.776335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9eb2ed0d-bd27-4f14-b96f-de8a40ee374a tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.142929 Jun 07 13:19:52.776905 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 133/258] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:52 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:52.784489 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-caa48ddd-3bb3-44f8-a526-f1762d100aa9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:52.785166 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-caa48ddd-3bb3-44f8-a526-f1762d100aa9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:52.791815 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-caa48ddd-3bb3-44f8-a526-f1762d100aa9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.792257 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-caa48ddd-3bb3-44f8-a526-f1762d100aa9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.793015 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-caa48ddd-3bb3-44f8-a526-f1762d100aa9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.793446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-caa48ddd-3bb3-44f8-a526-f1762d100aa9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.926543 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-caa48ddd-3bb3-44f8-a526-f1762d100aa9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:52.933920 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-caa48ddd-3bb3-44f8-a526-f1762d100aa9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.153354 Jun 07 13:19:52.934483 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 126/259] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:52 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:53.507384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9ccfeaf5-7a04-4b40-add1-2111213f5df1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:53.507993 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9ccfeaf5-7a04-4b40-add1-2111213f5df1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:53.514009 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9ccfeaf5-7a04-4b40-add1-2111213f5df1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.514455 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9ccfeaf5-7a04-4b40-add1-2111213f5df1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.515237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9ccfeaf5-7a04-4b40-add1-2111213f5df1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.515669 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9ccfeaf5-7a04-4b40-add1-2111213f5df1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.648689 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9ccfeaf5-7a04-4b40-add1-2111213f5df1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:53.656656 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9ccfeaf5-7a04-4b40-add1-2111213f5df1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1498 microversion: 2.1 time: 0.153474 Jun 07 13:19:53.661711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 134/260] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:53 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:53.676193 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:53.676716 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:53.685157 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.686053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.686881 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.687513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.793129 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-81855f05-537b-4a84-b3e3-741fa5cccf90 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:53.794182 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-81855f05-537b-4a84-b3e3-741fa5cccf90 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:53.799914 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-81855f05-537b-4a84-b3e3-741fa5cccf90 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.800364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-81855f05-537b-4a84-b3e3-741fa5cccf90 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.801323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-81855f05-537b-4a84-b3e3-741fa5cccf90 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.801766 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-81855f05-537b-4a84-b3e3-741fa5cccf90 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.831941 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:53.842079 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:53.844029 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:53.845538 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5e360400-4932-42b8-b1fc-b904572801bc tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.174035 Jun 07 13:19:53.846287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 127/261] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:53 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:53.852480 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-e8a4a5ec-77d0-4271-a36b-b98466ec72e1 req-3d92fa31-dc76-4c70-bef8-658526b230b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edff24ec-db4a-4fe9-b564-9dabd56acf8e", "name": "network-vif-plugged", "status": "completed", "tag": "bcd3488e-becb-41b9-ad34-acd79eb0dd17"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:53.862030 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-e8a4a5ec-77d0-4271-a36b-b98466ec72e1 req-3d92fa31-dc76-4c70-bef8-658526b230b1 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.862605 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-e8a4a5ec-77d0-4271-a36b-b98466ec72e1 req-3d92fa31-dc76-4c70-bef8-658526b230b1 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.875173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-e8a4a5ec-77d0-4271-a36b-b98466ec72e1 req-3d92fa31-dc76-4c70-bef8-658526b230b1 service nova] Creating event network-vif-plugged:bcd3488e-becb-41b9-ad34-acd79eb0dd17 for instance edff24ec-db4a-4fe9-b564-9dabd56acf8e on hv-cinder-84460 Jun 07 13:19:53.880437 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-e8a4a5ec-77d0-4271-a36b-b98466ec72e1 req-3d92fa31-dc76-4c70-bef8-658526b230b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032712 Jun 07 13:19:53.881226 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 128/262] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:53.952599 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5187be02-4405-4ac8-bcbe-f1a716db0dbe tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:53.953319 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5187be02-4405-4ac8-bcbe-f1a716db0dbe tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:53.955300 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-81855f05-537b-4a84-b3e3-741fa5cccf90 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:53.960319 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5187be02-4405-4ac8-bcbe-f1a716db0dbe tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.960809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5187be02-4405-4ac8-bcbe-f1a716db0dbe tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.961587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5187be02-4405-4ac8-bcbe-f1a716db0dbe tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.962019 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5187be02-4405-4ac8-bcbe-f1a716db0dbe tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.970874 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-81855f05-537b-4a84-b3e3-741fa5cccf90 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.176785 Jun 07 13:19:53.970874 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 135/263] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:53 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:54.093511 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5187be02-4405-4ac8-bcbe-f1a716db0dbe tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:54.101797 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5187be02-4405-4ac8-bcbe-f1a716db0dbe tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.154413 Jun 07 13:19:54.102374 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 129/264] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:53 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:54.547502 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9cf69f07-e8fd-4ab0-be52-de385b6dffe9 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:54.547997 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9cf69f07-e8fd-4ab0-be52-de385b6dffe9 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:54.554564 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9cf69f07-e8fd-4ab0-be52-de385b6dffe9 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.554808 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9cf69f07-e8fd-4ab0-be52-de385b6dffe9 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.555588 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9cf69f07-e8fd-4ab0-be52-de385b6dffe9 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.556017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9cf69f07-e8fd-4ab0-be52-de385b6dffe9 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.581145 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9cf69f07-e8fd-4ab0-be52-de385b6dffe9 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:19:54.653187 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9cf69f07-e8fd-4ab0-be52-de385b6dffe9 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 204 len: 0 microversion: 2.1 time: 0.109257 Jun 07 13:19:54.653701 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 136/265] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:19:54 2022] DELETE /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:19:54.662340 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c0d220cf-075e-4e0e-a3a8-357c77c10b38 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:54.663666 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c0d220cf-075e-4e0e-a3a8-357c77c10b38 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:54.669659 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0d220cf-075e-4e0e-a3a8-357c77c10b38 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.670115 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0d220cf-075e-4e0e-a3a8-357c77c10b38 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.670933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0d220cf-075e-4e0e-a3a8-357c77c10b38 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.671370 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0d220cf-075e-4e0e-a3a8-357c77c10b38 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.803108 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c0d220cf-075e-4e0e-a3a8-357c77c10b38 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:54.810648 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c0d220cf-075e-4e0e-a3a8-357c77c10b38 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1504 microversion: 2.1 time: 0.152572 Jun 07 13:19:54.811303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 130/266] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:54 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:54.864838 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:54.865734 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:54.872005 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.872449 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.873203 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.873636 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.985330 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-69eabee2-314f-4b87-af43-7e39871b8e4f tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:54.985939 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-69eabee2-314f-4b87-af43-7e39871b8e4f tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:54.991992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-69eabee2-314f-4b87-af43-7e39871b8e4f tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.992435 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-69eabee2-314f-4b87-af43-7e39871b8e4f tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.993187 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-69eabee2-314f-4b87-af43-7e39871b8e4f tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.993622 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-69eabee2-314f-4b87-af43-7e39871b8e4f tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.001845 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.010237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.011753 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.012856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-739865a9-89b1-4b39-b791-d2ac2fbbd0e4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1406 microversion: 2.20 time: 0.152744 Jun 07 13:19:55.013412 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 137/267] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:54 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:55.121370 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1a638042-e6ad-409a-b6fa-01c2ce2b07b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:55.121973 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-69eabee2-314f-4b87-af43-7e39871b8e4f tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.122184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1a638042-e6ad-409a-b6fa-01c2ce2b07b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:55.133766 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1a638042-e6ad-409a-b6fa-01c2ce2b07b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.134111 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-69eabee2-314f-4b87-af43-7e39871b8e4f tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.152502 Jun 07 13:19:55.134247 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1a638042-e6ad-409a-b6fa-01c2ce2b07b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.134723 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 131/268] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:54 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:55.139351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1a638042-e6ad-409a-b6fa-01c2ce2b07b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.139998 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1a638042-e6ad-409a-b6fa-01c2ce2b07b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.159429 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:55.274504 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1a638042-e6ad-409a-b6fa-01c2ce2b07b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.284062 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1a638042-e6ad-409a-b6fa-01c2ce2b07b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.168696 Jun 07 13:19:55.284742 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 138/269] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:55 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:55.832809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ffdc4081-d47b-4ca9-95dd-9e9c0a19adfe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:55.833590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ffdc4081-d47b-4ca9-95dd-9e9c0a19adfe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:55.841596 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ffdc4081-d47b-4ca9-95dd-9e9c0a19adfe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.842068 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ffdc4081-d47b-4ca9-95dd-9e9c0a19adfe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.842853 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ffdc4081-d47b-4ca9-95dd-9e9c0a19adfe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.843352 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ffdc4081-d47b-4ca9-95dd-9e9c0a19adfe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.986781 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ffdc4081-d47b-4ca9-95dd-9e9c0a19adfe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.995080 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ffdc4081-d47b-4ca9-95dd-9e9c0a19adfe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1504 microversion: 2.1 time: 0.169183 Jun 07 13:19:55.995740 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 132/270] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:55 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:56.031164 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.031792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.038930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.039382 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.040146 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.040636 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.151922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-76dce67b-f575-46f3-b56a-6affeddd92d3 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.152531 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-76dce67b-f575-46f3-b56a-6affeddd92d3 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.158476 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76dce67b-f575-46f3-b56a-6affeddd92d3 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.158964 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76dce67b-f575-46f3-b56a-6affeddd92d3 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.159719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76dce67b-f575-46f3-b56a-6affeddd92d3 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.160146 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76dce67b-f575-46f3-b56a-6affeddd92d3 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.168331 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.176119 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.177611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.179332 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a6cb98c7-65dc-4574-bca5-e8dd4ef5fc3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1599 microversion: 2.20 time: 0.152397 Jun 07 13:19:56.179909 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 139/271] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:56.196864 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-01c52d03-3d02-4c4e-821b-e8fbeac5ba32 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.197350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-01c52d03-3d02-4c4e-821b-e8fbeac5ba32 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.203396 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01c52d03-3d02-4c4e-821b-e8fbeac5ba32 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.203843 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01c52d03-3d02-4c4e-821b-e8fbeac5ba32 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.204626 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01c52d03-3d02-4c4e-821b-e8fbeac5ba32 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.205059 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01c52d03-3d02-4c4e-821b-e8fbeac5ba32 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.308251 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-01c52d03-3d02-4c4e-821b-e8fbeac5ba32 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.115628 Jun 07 13:19:56.308849 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 140/272] 10.222.0.61 () {60 vars in 1315 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:19:56.313491 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-84d0e423-e11f-417c-8aaf-3781f62de8e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.314093 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-84d0e423-e11f-417c-8aaf-3781f62de8e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.320495 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-84d0e423-e11f-417c-8aaf-3781f62de8e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.320934 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-84d0e423-e11f-417c-8aaf-3781f62de8e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.321696 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-84d0e423-e11f-417c-8aaf-3781f62de8e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.322128 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-84d0e423-e11f-417c-8aaf-3781f62de8e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.335121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-76dce67b-f575-46f3-b56a-6affeddd92d3 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.342404 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-76dce67b-f575-46f3-b56a-6affeddd92d3 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.194331 Jun 07 13:19:56.343536 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 133/273] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:56.640365 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-84d0e423-e11f-417c-8aaf-3781f62de8e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.648281 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-84d0e423-e11f-417c-8aaf-3781f62de8e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.338388 Jun 07 13:19:56.648853 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 141/274] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:57.014524 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7696ee52-7722-4a99-8c29-73824ebfe472 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:57.016184 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-7696ee52-7722-4a99-8c29-73824ebfe472 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:57.035657 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7696ee52-7722-4a99-8c29-73824ebfe472 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.036409 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7696ee52-7722-4a99-8c29-73824ebfe472 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.037364 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7696ee52-7722-4a99-8c29-73824ebfe472 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.038434 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7696ee52-7722-4a99-8c29-73824ebfe472 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.201839 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7696ee52-7722-4a99-8c29-73824ebfe472 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:57.210614 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7696ee52-7722-4a99-8c29-73824ebfe472 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1504 microversion: 2.1 time: 0.202081 Jun 07 13:19:57.211506 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 134/275] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:57 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:57.295804 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-a0e2663a-7de2-4a48-84d2-a748387ea7ce req-ff48b729-6812-4bdf-b7dd-1c54dd8ed21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2d4bcb-ea81-4550-be2e-2689fffd0943", "tag": "4846c4cd-df7f-498e-a460-3a57b147fedb"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:57.304548 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-a0e2663a-7de2-4a48-84d2-a748387ea7ce req-ff48b729-6812-4bdf-b7dd-1c54dd8ed21f service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.305067 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-a0e2663a-7de2-4a48-84d2-a748387ea7ce req-ff48b729-6812-4bdf-b7dd-1c54dd8ed21f service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.316876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-a0e2663a-7de2-4a48-84d2-a748387ea7ce req-ff48b729-6812-4bdf-b7dd-1c54dd8ed21f service nova] Creating event network-changed:4846c4cd-df7f-498e-a460-3a57b147fedb for instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 on hv-cinder-84460 Jun 07 13:19:57.322303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-a0e2663a-7de2-4a48-84d2-a748387ea7ce req-ff48b729-6812-4bdf-b7dd-1c54dd8ed21f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030214 Jun 07 13:19:57.324377 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 142/276] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:57.360523 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7ca94283-dc91-477c-83ab-ff410f0dd164 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:57.361072 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-7ca94283-dc91-477c-83ab-ff410f0dd164 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:57.367623 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7ca94283-dc91-477c-83ab-ff410f0dd164 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.368328 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7ca94283-dc91-477c-83ab-ff410f0dd164 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.369168 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7ca94283-dc91-477c-83ab-ff410f0dd164 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.369796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7ca94283-dc91-477c-83ab-ff410f0dd164 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.502363 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7ca94283-dc91-477c-83ab-ff410f0dd164 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:57.510935 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7ca94283-dc91-477c-83ab-ff410f0dd164 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.154235 Jun 07 13:19:57.511900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 135/277] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:57 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:57.672238 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-72f63be2-17f0-4f51-89cb-51ddf2068f22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:57.673204 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-72f63be2-17f0-4f51-89cb-51ddf2068f22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:57.679408 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72f63be2-17f0-4f51-89cb-51ddf2068f22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.679946 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72f63be2-17f0-4f51-89cb-51ddf2068f22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.680778 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72f63be2-17f0-4f51-89cb-51ddf2068f22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.681288 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72f63be2-17f0-4f51-89cb-51ddf2068f22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.807715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-72f63be2-17f0-4f51-89cb-51ddf2068f22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:57.815284 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-72f63be2-17f0-4f51-89cb-51ddf2068f22 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.147206 Jun 07 13:19:57.815857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 143/278] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:57 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:58.227930 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1831091f-0d1c-4b9a-8b3a-dcfc0779b15c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:58.228700 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1831091f-0d1c-4b9a-8b3a-dcfc0779b15c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:58.235344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1831091f-0d1c-4b9a-8b3a-dcfc0779b15c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.235802 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1831091f-0d1c-4b9a-8b3a-dcfc0779b15c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.236572 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1831091f-0d1c-4b9a-8b3a-dcfc0779b15c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.237008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1831091f-0d1c-4b9a-8b3a-dcfc0779b15c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.376762 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1831091f-0d1c-4b9a-8b3a-dcfc0779b15c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:58.385144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1831091f-0d1c-4b9a-8b3a-dcfc0779b15c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1504 microversion: 2.1 time: 0.160970 Jun 07 13:19:58.385694 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 136/279] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:58 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:58.528269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c7212aaa-a160-4a48-a48f-b05337214a4d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:58.528909 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c7212aaa-a160-4a48-a48f-b05337214a4d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:58.535006 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c7212aaa-a160-4a48-a48f-b05337214a4d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.535453 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c7212aaa-a160-4a48-a48f-b05337214a4d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.536208 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c7212aaa-a160-4a48-a48f-b05337214a4d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.536640 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c7212aaa-a160-4a48-a48f-b05337214a4d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.663655 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c7212aaa-a160-4a48-a48f-b05337214a4d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:58.671227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c7212aaa-a160-4a48-a48f-b05337214a4d tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.146734 Jun 07 13:19:58.671802 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 144/280] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:58 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:58.832643 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-248b87e0-6c45-41d2-932a-840bb7612ba3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:58.833252 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-248b87e0-6c45-41d2-932a-840bb7612ba3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:58.839260 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-248b87e0-6c45-41d2-932a-840bb7612ba3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.839708 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-248b87e0-6c45-41d2-932a-840bb7612ba3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.840453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-248b87e0-6c45-41d2-932a-840bb7612ba3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.840880 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-248b87e0-6c45-41d2-932a-840bb7612ba3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.963231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-248b87e0-6c45-41d2-932a-840bb7612ba3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:58.970554 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-248b87e0-6c45-41d2-932a-840bb7612ba3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.141750 Jun 07 13:19:58.971145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 137/281] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:58 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:59.401850 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0c06c8f1-65f4-410c-8bf6-3b2c060ba865 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:59.402468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0c06c8f1-65f4-410c-8bf6-3b2c060ba865 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:59.408905 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0c06c8f1-65f4-410c-8bf6-3b2c060ba865 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.409352 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0c06c8f1-65f4-410c-8bf6-3b2c060ba865 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.410100 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0c06c8f1-65f4-410c-8bf6-3b2c060ba865 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.410531 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0c06c8f1-65f4-410c-8bf6-3b2c060ba865 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.542761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0c06c8f1-65f4-410c-8bf6-3b2c060ba865 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:59.550239 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0c06c8f1-65f4-410c-8bf6-3b2c060ba865 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1504 microversion: 2.1 time: 0.152138 Jun 07 13:19:59.550807 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 145/282] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:59 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:59.688529 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6b529fec-7e8f-473f-a328-bccdff584249 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:59.689141 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6b529fec-7e8f-473f-a328-bccdff584249 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:59.696258 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6b529fec-7e8f-473f-a328-bccdff584249 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.696688 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6b529fec-7e8f-473f-a328-bccdff584249 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.697446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6b529fec-7e8f-473f-a328-bccdff584249 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.697883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6b529fec-7e8f-473f-a328-bccdff584249 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.701878 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:59.827610 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6b529fec-7e8f-473f-a328-bccdff584249 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:59.835300 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6b529fec-7e8f-473f-a328-bccdff584249 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.150642 Jun 07 13:19:59.835882 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 138/283] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:59 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:59.988276 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fecb5fa5-5d2d-4155-b35f-b902ad95acbf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:59.988919 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fecb5fa5-5d2d-4155-b35f-b902ad95acbf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:59.995564 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fecb5fa5-5d2d-4155-b35f-b902ad95acbf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.995960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fecb5fa5-5d2d-4155-b35f-b902ad95acbf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.996722 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fecb5fa5-5d2d-4155-b35f-b902ad95acbf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.997165 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fecb5fa5-5d2d-4155-b35f-b902ad95acbf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.122716 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fecb5fa5-5d2d-4155-b35f-b902ad95acbf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:00.130172 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fecb5fa5-5d2d-4155-b35f-b902ad95acbf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.145732 Jun 07 13:20:00.130743 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 146/284] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:59 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:00.567136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-312648a7-8a87-47ca-b7f0-dc4302fc3bc1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:00.567659 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-312648a7-8a87-47ca-b7f0-dc4302fc3bc1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:00.574151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-312648a7-8a87-47ca-b7f0-dc4302fc3bc1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.574595 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-312648a7-8a87-47ca-b7f0-dc4302fc3bc1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.575380 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-312648a7-8a87-47ca-b7f0-dc4302fc3bc1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.575811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-312648a7-8a87-47ca-b7f0-dc4302fc3bc1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.702142 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-312648a7-8a87-47ca-b7f0-dc4302fc3bc1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:00.709632 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-312648a7-8a87-47ca-b7f0-dc4302fc3bc1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1504 microversion: 2.1 time: 0.146431 Jun 07 13:20:00.710202 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 139/285] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:00 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:00.852222 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-368e1577-4fee-4756-a235-16739486a56b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:00.852767 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-368e1577-4fee-4756-a235-16739486a56b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:00.858740 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-368e1577-4fee-4756-a235-16739486a56b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.859225 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-368e1577-4fee-4756-a235-16739486a56b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.859976 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-368e1577-4fee-4756-a235-16739486a56b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.860405 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-368e1577-4fee-4756-a235-16739486a56b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.982747 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-368e1577-4fee-4756-a235-16739486a56b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:00.990173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-368e1577-4fee-4756-a235-16739486a56b tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.142595 Jun 07 13:20:00.990783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 147/286] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:00 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:01.147764 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-50dc0818-1e48-45dc-ab04-b8b396de2595 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:01.148303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-50dc0818-1e48-45dc-ab04-b8b396de2595 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:01.154254 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-50dc0818-1e48-45dc-ab04-b8b396de2595 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.154708 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-50dc0818-1e48-45dc-ab04-b8b396de2595 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.155621 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-50dc0818-1e48-45dc-ab04-b8b396de2595 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.156059 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-50dc0818-1e48-45dc-ab04-b8b396de2595 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.283057 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-50dc0818-1e48-45dc-ab04-b8b396de2595 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:01.291410 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-50dc0818-1e48-45dc-ab04-b8b396de2595 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.148075 Jun 07 13:20:01.291984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 140/287] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:01 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:01.725815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d5fada4b-b972-478e-b978-e13d6c3fa1e7 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:01.726428 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d5fada4b-b972-478e-b978-e13d6c3fa1e7 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:01.732645 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d5fada4b-b972-478e-b978-e13d6c3fa1e7 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.733092 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d5fada4b-b972-478e-b978-e13d6c3fa1e7 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.733854 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d5fada4b-b972-478e-b978-e13d6c3fa1e7 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.734346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d5fada4b-b972-478e-b978-e13d6c3fa1e7 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.861649 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d5fada4b-b972-478e-b978-e13d6c3fa1e7 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:01.869249 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d5fada4b-b972-478e-b978-e13d6c3fa1e7 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1504 microversion: 2.1 time: 0.147437 Jun 07 13:20:01.869805 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 148/288] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:01 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:02.007513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-90d1ec35-fb69-4da5-b035-55ed0d3d070e tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:02.008128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-90d1ec35-fb69-4da5-b035-55ed0d3d070e tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:02.014576 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-90d1ec35-fb69-4da5-b035-55ed0d3d070e tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.015059 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-90d1ec35-fb69-4da5-b035-55ed0d3d070e tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.015814 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-90d1ec35-fb69-4da5-b035-55ed0d3d070e tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.016245 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-90d1ec35-fb69-4da5-b035-55ed0d3d070e tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.143182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-90d1ec35-fb69-4da5-b035-55ed0d3d070e tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:02.150584 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-90d1ec35-fb69-4da5-b035-55ed0d3d070e tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.147586 Jun 07 13:20:02.151176 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 141/289] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:02 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:02.309329 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-78177d17-2530-40e0-b69d-fc779416b3e8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:02.309859 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-78177d17-2530-40e0-b69d-fc779416b3e8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:02.315818 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-78177d17-2530-40e0-b69d-fc779416b3e8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.316264 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-78177d17-2530-40e0-b69d-fc779416b3e8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.317013 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-78177d17-2530-40e0-b69d-fc779416b3e8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.317446 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-78177d17-2530-40e0-b69d-fc779416b3e8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.451718 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-78177d17-2530-40e0-b69d-fc779416b3e8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:02.459380 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-78177d17-2530-40e0-b69d-fc779416b3e8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.153941 Jun 07 13:20:02.459966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 149/290] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:02 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:02.885186 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5459bc82-c58c-4d9e-9c45-7c5c597db2fa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:02.885821 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5459bc82-c58c-4d9e-9c45-7c5c597db2fa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:02.891799 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5459bc82-c58c-4d9e-9c45-7c5c597db2fa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.892256 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5459bc82-c58c-4d9e-9c45-7c5c597db2fa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.893020 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5459bc82-c58c-4d9e-9c45-7c5c597db2fa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.893458 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5459bc82-c58c-4d9e-9c45-7c5c597db2fa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.020743 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5459bc82-c58c-4d9e-9c45-7c5c597db2fa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:03.028900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5459bc82-c58c-4d9e-9c45-7c5c597db2fa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1504 microversion: 2.1 time: 0.147539 Jun 07 13:20:03.029468 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 142/291] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:02 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:03.167430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-aa6d3004-4284-40d3-8384-4e90c4c19f71 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:03.168044 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-aa6d3004-4284-40d3-8384-4e90c4c19f71 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:03.173948 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-aa6d3004-4284-40d3-8384-4e90c4c19f71 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.174396 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-aa6d3004-4284-40d3-8384-4e90c4c19f71 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.175211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-aa6d3004-4284-40d3-8384-4e90c4c19f71 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.175646 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-aa6d3004-4284-40d3-8384-4e90c4c19f71 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.300903 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-aa6d3004-4284-40d3-8384-4e90c4c19f71 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:03.308369 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-aa6d3004-4284-40d3-8384-4e90c4c19f71 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1315 microversion: 2.1 time: 0.144787 Jun 07 13:20:03.308943 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 150/292] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:03 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:03.475792 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-66d87c30-51a8-4f5e-bd47-7c3454c83b2a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:03.476406 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-66d87c30-51a8-4f5e-bd47-7c3454c83b2a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:03.482274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-66d87c30-51a8-4f5e-bd47-7c3454c83b2a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.482715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-66d87c30-51a8-4f5e-bd47-7c3454c83b2a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.483503 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-66d87c30-51a8-4f5e-bd47-7c3454c83b2a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.483937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-66d87c30-51a8-4f5e-bd47-7c3454c83b2a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.617548 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-66d87c30-51a8-4f5e-bd47-7c3454c83b2a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:03.625086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-66d87c30-51a8-4f5e-bd47-7c3454c83b2a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.153300 Jun 07 13:20:03.625658 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 143/293] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:03 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:04.045552 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c52ee5ff-aa1c-434d-818b-97f3d8042ecf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:04.046275 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c52ee5ff-aa1c-434d-818b-97f3d8042ecf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:04.055409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c52ee5ff-aa1c-434d-818b-97f3d8042ecf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.055875 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c52ee5ff-aa1c-434d-818b-97f3d8042ecf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.056719 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c52ee5ff-aa1c-434d-818b-97f3d8042ecf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.057206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c52ee5ff-aa1c-434d-818b-97f3d8042ecf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.152697 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-b15c4f94-d27b-456d-b336-2b7ca172dd53 req-e58719dc-1699-4612-b8d5-3082aeb5308c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9431594-ac28-4b88-bb34-c94ad9903743", "name": "network-vif-unplugged", "status": "completed", "tag": "a4698c40-1169-449b-8114-06c3b5e1c430"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:04.167253 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-b15c4f94-d27b-456d-b336-2b7ca172dd53 req-e58719dc-1699-4612-b8d5-3082aeb5308c service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.167717 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-b15c4f94-d27b-456d-b336-2b7ca172dd53 req-e58719dc-1699-4612-b8d5-3082aeb5308c service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.183722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-b15c4f94-d27b-456d-b336-2b7ca172dd53 req-e58719dc-1699-4612-b8d5-3082aeb5308c service nova] Creating event network-vif-unplugged:a4698c40-1169-449b-8114-06c3b5e1c430 for instance d9431594-ac28-4b88-bb34-c94ad9903743 on hv-cinder-84460 Jun 07 13:20:04.189197 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-b15c4f94-d27b-456d-b336-2b7ca172dd53 req-e58719dc-1699-4612-b8d5-3082aeb5308c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042558 Jun 07 13:20:04.189816 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 144/294] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:04.215213 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c52ee5ff-aa1c-434d-818b-97f3d8042ecf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.223014 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c52ee5ff-aa1c-434d-818b-97f3d8042ecf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1504 microversion: 2.1 time: 0.181380 Jun 07 13:20:04.223835 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 151/295] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:04 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:04.325959 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a2872ca1-109d-4145-8f21-a1ab02165e61 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:04.326649 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a2872ca1-109d-4145-8f21-a1ab02165e61 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:04.332961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a2872ca1-109d-4145-8f21-a1ab02165e61 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.333404 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a2872ca1-109d-4145-8f21-a1ab02165e61 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.334154 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a2872ca1-109d-4145-8f21-a1ab02165e61 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.335104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a2872ca1-109d-4145-8f21-a1ab02165e61 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.470737 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a2872ca1-109d-4145-8f21-a1ab02165e61 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.479118 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a2872ca1-109d-4145-8f21-a1ab02165e61 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1465 microversion: 2.1 time: 0.157313 Jun 07 13:20:04.479693 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 145/296] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:04 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:04.518033 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f4d3f824-57d9-49a7-8e8a-8be2a6a1da29 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:04.518533 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f4d3f824-57d9-49a7-8e8a-8be2a6a1da29 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:04.525513 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4d3f824-57d9-49a7-8e8a-8be2a6a1da29 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.525961 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4d3f824-57d9-49a7-8e8a-8be2a6a1da29 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.526750 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4d3f824-57d9-49a7-8e8a-8be2a6a1da29 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.527240 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4d3f824-57d9-49a7-8e8a-8be2a6a1da29 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.551579 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f4d3f824-57d9-49a7-8e8a-8be2a6a1da29 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:20:04.624023 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f4d3f824-57d9-49a7-8e8a-8be2a6a1da29 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "DELETE /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 204 len: 0 microversion: 2.1 time: 0.109474 Jun 07 13:20:04.624606 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 152/297] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:20:04 2022] DELETE /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:20:04.633307 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-dc50a465-c60f-42ec-8615-ee9af6820548 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:04.634160 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-dc50a465-c60f-42ec-8615-ee9af6820548 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:04.640189 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc50a465-c60f-42ec-8615-ee9af6820548 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.640632 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc50a465-c60f-42ec-8615-ee9af6820548 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.641394 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc50a465-c60f-42ec-8615-ee9af6820548 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.641829 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc50a465-c60f-42ec-8615-ee9af6820548 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.642968 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7e3c3165-d8ab-4179-97bb-107e47f23092 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:04.643638 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7e3c3165-d8ab-4179-97bb-107e47f23092 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:04.651974 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e3c3165-d8ab-4179-97bb-107e47f23092 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.652904 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e3c3165-d8ab-4179-97bb-107e47f23092 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.653435 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e3c3165-d8ab-4179-97bb-107e47f23092 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.654028 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e3c3165-d8ab-4179-97bb-107e47f23092 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.844077 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-dc50a465-c60f-42ec-8615-ee9af6820548 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.852227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7e3c3165-d8ab-4179-97bb-107e47f23092 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.868390 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-dc50a465-c60f-42ec-8615-ee9af6820548 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1471 microversion: 2.1 time: 0.239161 Jun 07 13:20:04.871142 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 146/298] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:04 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:04.877185 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7e3c3165-d8ab-4179-97bb-107e47f23092 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.238352 Jun 07 13:20:04.877992 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 153/299] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:04 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:05.240955 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fe914398-bbc1-478b-8249-9f5fbb6d4ae4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:05.242099 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fe914398-bbc1-478b-8249-9f5fbb6d4ae4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:05.251566 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fe914398-bbc1-478b-8249-9f5fbb6d4ae4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.252020 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fe914398-bbc1-478b-8249-9f5fbb6d4ae4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.252801 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fe914398-bbc1-478b-8249-9f5fbb6d4ae4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.253239 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fe914398-bbc1-478b-8249-9f5fbb6d4ae4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.262756 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-f2f52545-d18a-4f38-ba9b-47b41c67dfdf req-3f2d12fb-73b5-4c99-ac81-d73625b022fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9431594-ac28-4b88-bb34-c94ad9903743", "name": "network-vif-deleted", "tag": "a4698c40-1169-449b-8114-06c3b5e1c430"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:05.271796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f2f52545-d18a-4f38-ba9b-47b41c67dfdf req-3f2d12fb-73b5-4c99-ac81-d73625b022fc service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.272983 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f2f52545-d18a-4f38-ba9b-47b41c67dfdf req-3f2d12fb-73b5-4c99-ac81-d73625b022fc service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.287368 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-f2f52545-d18a-4f38-ba9b-47b41c67dfdf req-3f2d12fb-73b5-4c99-ac81-d73625b022fc service nova] Creating event network-vif-deleted:a4698c40-1169-449b-8114-06c3b5e1c430 for instance d9431594-ac28-4b88-bb34-c94ad9903743 on hv-cinder-84460 Jun 07 13:20:05.295274 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-f2f52545-d18a-4f38-ba9b-47b41c67dfdf req-3f2d12fb-73b5-4c99-ac81-d73625b022fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036889 Jun 07 13:20:05.296188 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 154/300] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:05.328441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fe914398-bbc1-478b-8249-9f5fbb6d4ae4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:05.336688 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fe914398-bbc1-478b-8249-9f5fbb6d4ae4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1462 microversion: 2.1 time: 0.100063 Jun 07 13:20:05.337438 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 147/301] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:05 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1462 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:05.888132 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-39587cb7-7f45-4783-b57f-256a25c28cf8 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:05.888820 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-39587cb7-7f45-4783-b57f-256a25c28cf8 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:05.894813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d7d0bf3d-be52-49a9-b315-2076a9763a76 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:05.895510 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d7d0bf3d-be52-49a9-b315-2076a9763a76 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:05.896063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39587cb7-7f45-4783-b57f-256a25c28cf8 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.896516 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39587cb7-7f45-4783-b57f-256a25c28cf8 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.897289 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39587cb7-7f45-4783-b57f-256a25c28cf8 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.897731 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39587cb7-7f45-4783-b57f-256a25c28cf8 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.901777 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d7d0bf3d-be52-49a9-b315-2076a9763a76 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.902208 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:05.902336 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d7d0bf3d-be52-49a9-b315-2076a9763a76 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.903177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d7d0bf3d-be52-49a9-b315-2076a9763a76 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.903772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d7d0bf3d-be52-49a9-b315-2076a9763a76 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.100925 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-39587cb7-7f45-4783-b57f-256a25c28cf8 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:06.105032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d7d0bf3d-be52-49a9-b315-2076a9763a76 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:06.109286 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-39587cb7-7f45-4783-b57f-256a25c28cf8 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1471 microversion: 2.1 time: 0.226251 Jun 07 13:20:06.110079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 155/302] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:05 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:06.112378 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d7d0bf3d-be52-49a9-b315-2076a9763a76 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.221324 Jun 07 13:20:06.113172 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 148/303] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:05 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:06.354300 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:06.354952 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:06.361113 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:06.361567 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.362333 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:06.362871 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.391908 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:06.392364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.392811 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lazy-loading 'fault' on Instance uuid d9431594-ac28-4b88-bb34-c94ad9903743 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:20:06.447286 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:06.454564 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3c275648-45f5-4184-be68-4c5250d393db tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1303 microversion: 2.1 time: 0.104792 Jun 07 13:20:06.455165 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 156/304] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:06 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:07.128829 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e5fe6a4b-1f54-4bd8-ba7d-f5942a3369a6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:07.129347 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3de7387d-f330-4da0-9cfa-c9a9c068caaf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:07.129634 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e5fe6a4b-1f54-4bd8-ba7d-f5942a3369a6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:07.129888 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3de7387d-f330-4da0-9cfa-c9a9c068caaf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:07.136030 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3de7387d-f330-4da0-9cfa-c9a9c068caaf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.136489 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3de7387d-f330-4da0-9cfa-c9a9c068caaf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.136916 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e5fe6a4b-1f54-4bd8-ba7d-f5942a3369a6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.137457 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3de7387d-f330-4da0-9cfa-c9a9c068caaf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.137710 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e5fe6a4b-1f54-4bd8-ba7d-f5942a3369a6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.138032 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3de7387d-f330-4da0-9cfa-c9a9c068caaf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.138644 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e5fe6a4b-1f54-4bd8-ba7d-f5942a3369a6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.139236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e5fe6a4b-1f54-4bd8-ba7d-f5942a3369a6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.328362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3de7387d-f330-4da0-9cfa-c9a9c068caaf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:07.332541 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e5fe6a4b-1f54-4bd8-ba7d-f5942a3369a6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:07.337408 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3de7387d-f330-4da0-9cfa-c9a9c068caaf tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.212009 Jun 07 13:20:07.338765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 157/305] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:07 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:07.348817 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e5fe6a4b-1f54-4bd8-ba7d-f5942a3369a6 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1471 microversion: 2.1 time: 0.224257 Jun 07 13:20:07.349645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 149/306] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:07 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:07.473839 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:07.474466 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:07.481776 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.482237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.483085 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.483486 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.520362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.520782 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.521436 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lazy-loading 'fault' on Instance uuid d9431594-ac28-4b88-bb34-c94ad9903743 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:20:07.563704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:07.571549 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fc9e9802-3708-465c-9610-c02b5cebf5ba tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 200 len: 1303 microversion: 2.1 time: 0.101841 Jun 07 13:20:07.572158 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 158/307] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:07 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:08.355797 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-53e7775a-dcc3-447a-b792-64accffe7c14 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:08.356500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-53e7775a-dcc3-447a-b792-64accffe7c14 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:08.363446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-53e7775a-dcc3-447a-b792-64accffe7c14 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.363937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-53e7775a-dcc3-447a-b792-64accffe7c14 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.364701 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-53e7775a-dcc3-447a-b792-64accffe7c14 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.365132 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-53e7775a-dcc3-447a-b792-64accffe7c14 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.366015 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-07c263e7-743f-428c-a574-4e8bf244bd5c tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:08.366848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-07c263e7-743f-428c-a574-4e8bf244bd5c tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:08.374663 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-07c263e7-743f-428c-a574-4e8bf244bd5c tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.375427 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-07c263e7-743f-428c-a574-4e8bf244bd5c tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.376295 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-07c263e7-743f-428c-a574-4e8bf244bd5c tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.376789 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-07c263e7-743f-428c-a574-4e8bf244bd5c tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.630992 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-07c263e7-743f-428c-a574-4e8bf244bd5c tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:08.635841 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-53e7775a-dcc3-447a-b792-64accffe7c14 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:08.642514 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-07c263e7-743f-428c-a574-4e8bf244bd5c tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1471 microversion: 2.1 time: 0.280077 Jun 07 13:20:08.643848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 159/308] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:08 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:08.652684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:08.653960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: d9431594-ac28-4b88-bb34-c94ad9903743] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:08.656008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-53e7775a-dcc3-447a-b792-64accffe7c14 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.304230 Jun 07 13:20:08.656683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 150/309] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:08 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:08.665329 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.666082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.667239 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:08.667871 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.683284 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] HTTP exception thrown: Instance d9431594-ac28-4b88-bb34-c94ad9903743 could not be found. Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Request method failure captured: Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 HTTP/1.1 Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1BdBToYwgbXPlpROZfzeXgie99GimX_3Tc3pKS3xpBBskJnEeuHcUZwyD6fBlPKTwFDpJJ6AXR9wWqdAzibpTxGyWOvedMVnykBt_wNIoyZf-EjwGfWLAgzHpMo9nRzvXVeN8jU2XbwfN31fdh99H4L0uSfBHEQpnv868jIOj_pCHw Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: d1aac41f4f074858ba560987a158c38b Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-VolumesActionsTest-2110775270 Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:20:08.684930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d1aac41f4f074858ba560987a158c38b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d1aac41f4f074858ba560987a158c38b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d1aac41f4f074858ba560987a158c38b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d1aac41f4f074858ba560987a158c38b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-VolumesActionsTest-2110775270 Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: d1aac41f4f074858ba560987a158c38b Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-VolumesActionsTest-2110775270 Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-VolumesActionsTest-2110775270-project Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 51d5d87476eb4c8d8ceacf022fe4135d Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-VolumesActionsTest-2110775270-project Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance d9431594-ac28-4b88-bb34-c94ad9903743 could not be found. Jun 07 13:20:08.686496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': 'd9431594-ac28-4b88-bb34-c94ad9903743'} Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9431594-ac28-4b88-bb34-c94ad9903743 could not be found. Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:20:08.687364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9431594-ac28-4b88-bb34-c94ad9903743 could not be found. Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9431594-ac28-4b88-bb34-c94ad9903743 could not be found. Jun 07 13:20:08.688840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:08.690652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Returning 404 to user: Instance d9431594-ac28-4b88-bb34-c94ad9903743 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:20:08.691646 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fca2c48c-ac07-4fdf-a0e7-0570cadc3b61 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743" status: 404 len: 111 microversion: 2.1 time: 0.045837 Jun 07 13:20:08.693430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 160/310] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:08 2022] GET /compute/v2.1/servers/d9431594-ac28-4b88-bb34-c94ad9903743 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:20:08.812822 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-577209716", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "networks": [{"uuid": "58ad666e-46d6-4776-ba36-924ba1b46cc1"}]}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:08.872389 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] validate_networks() for [('58ad666e-46d6-4776-ba36-924ba1b46cc1', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:20:09.071918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-f041fd2c-048b-4e68-afcb-0cfaeee7e05d req-ee4e7bfd-4a55-4a7f-abd6-c3c0bc0ebb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edff24ec-db4a-4fe9-b564-9dabd56acf8e", "name": "network-vif-deleted", "tag": "bcd3488e-becb-41b9-ad34-acd79eb0dd17"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:09.087748 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f041fd2c-048b-4e68-afcb-0cfaeee7e05d req-ee4e7bfd-4a55-4a7f-abd6-c3c0bc0ebb85 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.088760 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f041fd2c-048b-4e68-afcb-0cfaeee7e05d req-ee4e7bfd-4a55-4a7f-abd6-c3c0bc0ebb85 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.106206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-f041fd2c-048b-4e68-afcb-0cfaeee7e05d req-ee4e7bfd-4a55-4a7f-abd6-c3c0bc0ebb85 service nova] Creating event network-vif-deleted:bcd3488e-becb-41b9-ad34-acd79eb0dd17 for instance edff24ec-db4a-4fe9-b564-9dabd56acf8e on hv-cinder-84460 Jun 07 13:20:09.123203 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-f041fd2c-048b-4e68-afcb-0cfaeee7e05d req-ee4e7bfd-4a55-4a7f-abd6-c3c0bc0ebb85 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047051 Jun 07 13:20:09.123877 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 161/311] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:09.414253 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:20:09.414740 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:20:09.415200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:20:09.415629 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:20:09.416039 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:20:09.427257 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.427746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.428534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.429194 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.448173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Getting quotas for project d1aac41f4f074858ba560987a158c38b. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:09.452267 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Getting quotas for user 51d5d87476eb4c8d8ceacf022fe4135d and project d1aac41f4f074858ba560987a158c38b. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:09.464512 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:20:09.467096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:20:09.516235 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f73c0864-55f3-430f-84d4-2faaf4b592e4 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707476 Jun 07 13:20:09.517462 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 151/312] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:20:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:20:09.527840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4d42fa1d-43b4-491b-a8dc-37d4cf3f3814 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:09.528542 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4d42fa1d-43b4-491b-a8dc-37d4cf3f3814 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:09.584343 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4d42fa1d-43b4-491b-a8dc-37d4cf3f3814 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:09.591730 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4d42fa1d-43b4-491b-a8dc-37d4cf3f3814 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1213 microversion: 2.1 time: 0.068027 Jun 07 13:20:09.592428 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 162/313] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:09 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:09.659876 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:09.660500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:09.667640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.667640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.667885 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.668258 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.674848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5563adbb-c5ea-47f2-a091-d4180ab6832a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:09.674848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5563adbb-c5ea-47f2-a091-d4180ab6832a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:09.683813 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5563adbb-c5ea-47f2-a091-d4180ab6832a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.684778 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5563adbb-c5ea-47f2-a091-d4180ab6832a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.685848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5563adbb-c5ea-47f2-a091-d4180ab6832a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.686447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5563adbb-c5ea-47f2-a091-d4180ab6832a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.707464 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.708137 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.708689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lazy-loading 'fault' on Instance uuid edff24ec-db4a-4fe9-b564-9dabd56acf8e {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:20:09.769531 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:09.779182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5c305e8e-8170-4192-a6a6-dcb294b40bf4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1305 microversion: 2.1 time: 0.122924 Jun 07 13:20:09.780241 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 152/314] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:09 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:09.859877 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5563adbb-c5ea-47f2-a091-d4180ab6832a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:09.869313 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5563adbb-c5ea-47f2-a091-d4180ab6832a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.199705 Jun 07 13:20:09.870672 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 163/315] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:09 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:10.612873 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a8486e05-118a-43d7-a4b9-1e0189caf4b1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:10.616382 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a8486e05-118a-43d7-a4b9-1e0189caf4b1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:10.628139 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a8486e05-118a-43d7-a4b9-1e0189caf4b1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.629671 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a8486e05-118a-43d7-a4b9-1e0189caf4b1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.631684 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a8486e05-118a-43d7-a4b9-1e0189caf4b1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.632122 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a8486e05-118a-43d7-a4b9-1e0189caf4b1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.715035 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a8486e05-118a-43d7-a4b9-1e0189caf4b1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:10.722530 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a8486e05-118a-43d7-a4b9-1e0189caf4b1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1217 microversion: 2.1 time: 0.115894 Jun 07 13:20:10.723134 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 153/316] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:10 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:10.795944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:10.796560 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:10.802702 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.803192 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.803972 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.804414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.843211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.844040 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.844674 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lazy-loading 'fault' on Instance uuid edff24ec-db4a-4fe9-b564-9dabd56acf8e {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:20:10.888510 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8d0a0f29-1698-43c5-851d-80c9587ae356 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:10.889210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8d0a0f29-1698-43c5-851d-80c9587ae356 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:10.895545 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d0a0f29-1698-43c5-851d-80c9587ae356 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.896223 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d0a0f29-1698-43c5-851d-80c9587ae356 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.897282 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d0a0f29-1698-43c5-851d-80c9587ae356 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.897872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d0a0f29-1698-43c5-851d-80c9587ae356 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.919685 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c2a65a3434df5abf5dc4ce53fddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c38e45e60ff4f5595a4b3bec32db245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:10.944654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2d20184a-7a2e-48a9-8c3e-577629c596fe tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 200 len: 1305 microversion: 2.1 time: 0.142628 Jun 07 13:20:10.946805 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 164/317] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:10 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:11.133199 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8d0a0f29-1698-43c5-851d-80c9587ae356 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:11.141373 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8d0a0f29-1698-43c5-851d-80c9587ae356 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1501 microversion: 2.1 time: 0.257503 Jun 07 13:20:11.141948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 154/318] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:10 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1501 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:11.157553 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbd5033d-9eef-4b40-a263-4f7549d3195c"}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:11.158674 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:11.164565 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.165013 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.165773 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.166209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.188727 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] HTTP exception thrown: Cannot 'attach_volume' instance 23bca688-1384-4f4d-a129-4129e290831c while it is in vm_state rescued Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Request method failure captured: Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: POST /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c/os-volume_attachments HTTP/1.1 Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 74 Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1ARh_w5x3eyvpxmWFo09bX4TSX7lLT_QFdDuGbNXfNSwNB7Ug2bSzEg0_5-gIjvqMn5A1vi5Xw8j5s7JEtRkwMs4XaMuLBw0pPzIbLaotV0Qulk_SIiHBUsGrk51-OZ_-x0oYSlJal38kNshd-TA2kCT8m4QD4_whvIVBFX_68qnus Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:20:11.190461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: dcf5286e9ca14f56905e6e247e411896 Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {"volumeAttachment": {"volumeId": "fbd5033d-9eef-4b40-a263-4f7549d3195c"}} Jun 07 13:20:11.191869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Cannot 'attach_volume' instance 23bca688-1384-4f4d-a129-4129e290831c while it is in vm_state rescued Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'server_id': '23bca688-1384-4f4d-a129-4129e290831c', 'body': {'volumeAttachment': {'volumeId': 'fbd5033d-9eef-4b40-a263-4f7549d3195c'}}} Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 23bca688-1384-4f4d-a129-4129e290831c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:20:11.192712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 23bca688-1384-4f4d-a129-4129e290831c while it is in vm_state rescued Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:11.194003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:11.195320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:20:11.195320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:20:11.195320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 23bca688-1384-4f4d-a129-4129e290831c while it is in vm_state rescued Jun 07 13:20:11.195320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:11.195320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Returning 409 to user: Cannot 'attach_volume' instance 23bca688-1384-4f4d-a129-4129e290831c while it is in vm_state rescued {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:20:11.195320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0649fb84-c136-4fab-a4ea-77d4040c040e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038426 Jun 07 13:20:11.195320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 165/319] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:20:11 2022] POST /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 13:20:11.201774 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b139dfcd-84b9-4fa3-ac8d-50b717f4e066 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:11.202315 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b139dfcd-84b9-4fa3-ac8d-50b717f4e066 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:11.208480 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b139dfcd-84b9-4fa3-ac8d-50b717f4e066 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.208929 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b139dfcd-84b9-4fa3-ac8d-50b717f4e066 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.209861 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b139dfcd-84b9-4fa3-ac8d-50b717f4e066 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.210461 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b139dfcd-84b9-4fa3-ac8d-50b717f4e066 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.239059 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=100 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:11.284478 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b139dfcd-84b9-4fa3-ac8d-50b717f4e066 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c/action" status: 202 len: 0 microversion: 2.1 time: 0.087154 Jun 07 13:20:11.285221 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 155/320] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:20:11 2022] POST /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:20:11.294479 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-af9868c4-2faf-49c2-b1d9-7d488f0ef9f4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:11.295145 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-af9868c4-2faf-49c2-b1d9-7d488f0ef9f4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:11.301267 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af9868c4-2faf-49c2-b1d9-7d488f0ef9f4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.301722 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af9868c4-2faf-49c2-b1d9-7d488f0ef9f4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.302485 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af9868c4-2faf-49c2-b1d9-7d488f0ef9f4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.302958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af9868c4-2faf-49c2-b1d9-7d488f0ef9f4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.510017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-af9868c4-2faf-49c2-b1d9-7d488f0ef9f4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:11.522451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-af9868c4-2faf-49c2-b1d9-7d488f0ef9f4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1509 microversion: 2.1 time: 0.232568 Jun 07 13:20:11.524669 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 166/321] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:11 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:11.740686 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-91e71f23-48f0-4ce5-aa21-999373fc37bf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:11.741392 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-91e71f23-48f0-4ce5-aa21-999373fc37bf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:11.747960 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-91e71f23-48f0-4ce5-aa21-999373fc37bf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.748518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-91e71f23-48f0-4ce5-aa21-999373fc37bf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.749342 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-91e71f23-48f0-4ce5-aa21-999373fc37bf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.749842 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-91e71f23-48f0-4ce5-aa21-999373fc37bf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.812042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-91e71f23-48f0-4ce5-aa21-999373fc37bf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:11.820070 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-91e71f23-48f0-4ce5-aa21-999373fc37bf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1265 microversion: 2.1 time: 0.084021 Jun 07 13:20:11.820951 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 156/322] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:11 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:11.970038 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:11.970655 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] [instance: edff24ec-db4a-4fe9-b564-9dabd56acf8e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:11.977118 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:11.986019 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.986469 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.989831 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.992594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:12.050860 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] HTTP exception thrown: Instance edff24ec-db4a-4fe9-b564-9dabd56acf8e could not be found. Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Request method failure captured: Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e HTTP/1.1 Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1BfUZ4tEhfeHZIdkBGfmpbmVOM65GG8CbCRKoX4_BgEUzoDU7YI320-wcoUGoIHM2L-9Fyo0QcGgbE_YnO6M1Nj3Ool4AvgizMSyP1NeJZbTT9exoyTWkwSZ1pwBtZfhIDhyzfxBJs1piXXvO88k3sBK7OxgoNllSP5FOUfMylSWOA Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 8c38e45e60ff4f5595a4b3bec32db245 Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-VolumesNegativeTest-2049516183 Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:20:12.052421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8c38e45e60ff4f5595a4b3bec32db245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8c38e45e60ff4f5595a4b3bec32db245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8c38e45e60ff4f5595a4b3bec32db245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8c38e45e60ff4f5595a4b3bec32db245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-VolumesNegativeTest-2049516183 Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 8c38e45e60ff4f5595a4b3bec32db245 Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-VolumesNegativeTest-2049516183 Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-VolumesNegativeTest-2049516183-project Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: e15c2a65a3434df5abf5dc4ce53fddc2 Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-VolumesNegativeTest-2049516183-project Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance edff24ec-db4a-4fe9-b564-9dabd56acf8e could not be found. Jun 07 13:20:12.053884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': 'edff24ec-db4a-4fe9-b564-9dabd56acf8e'} Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edff24ec-db4a-4fe9-b564-9dabd56acf8e could not be found. Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:20:12.055346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edff24ec-db4a-4fe9-b564-9dabd56acf8e could not be found. Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edff24ec-db4a-4fe9-b564-9dabd56acf8e could not be found. Jun 07 13:20:12.066929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:20:12.069451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] Returning 404 to user: Instance edff24ec-db4a-4fe9-b564-9dabd56acf8e could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:20:12.069451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5f722c93-f5f1-45e8-a7f4-95b8024f40d4 tempest-VolumesNegativeTest-2049516183 tempest-VolumesNegativeTest-2049516183-project] 10.222.0.61 "GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e" status: 404 len: 111 microversion: 2.1 time: 0.092888 Jun 07 13:20:12.069451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 167/323] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:11 2022] GET /compute/v2.1/servers/edff24ec-db4a-4fe9-b564-9dabd56acf8e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:20:12.541863 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4e58b36f-30df-4cad-a8c0-b299eb7ffd69 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:12.543324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4e58b36f-30df-4cad-a8c0-b299eb7ffd69 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:12.560288 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4e58b36f-30df-4cad-a8c0-b299eb7ffd69 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.564244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4e58b36f-30df-4cad-a8c0-b299eb7ffd69 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:12.568449 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4e58b36f-30df-4cad-a8c0-b299eb7ffd69 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.569554 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4e58b36f-30df-4cad-a8c0-b299eb7ffd69 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:12.788159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4e58b36f-30df-4cad-a8c0-b299eb7ffd69 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:12.800343 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4e58b36f-30df-4cad-a8c0-b299eb7ffd69 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1509 microversion: 2.1 time: 0.263344 Jun 07 13:20:12.802995 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 157/324] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:12 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1509 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:12.839628 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-52383194-5aca-4d43-b863-2f06fac2175d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:12.841129 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-52383194-5aca-4d43-b863-2f06fac2175d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:12.855216 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-52383194-5aca-4d43-b863-2f06fac2175d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.855708 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-52383194-5aca-4d43-b863-2f06fac2175d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:12.857469 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-52383194-5aca-4d43-b863-2f06fac2175d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.857924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-52383194-5aca-4d43-b863-2f06fac2175d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:13.001125 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-52383194-5aca-4d43-b863-2f06fac2175d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:13.021911 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-52383194-5aca-4d43-b863-2f06fac2175d tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1271 microversion: 2.1 time: 0.187990 Jun 07 13:20:13.022485 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 168/325] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:12 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:13.043692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a7fa7bda-1407-42e7-8f5a-7c163bd09a74 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: .version_select at 0x7f46a3fea160>, body: {"keypair": {"name": "tempest-keypair-2012735776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeXMbAX6YLkUVJ4NjHWlhvCfMb/Gvwva38JTBT5jpQDHC9OokPF3kxFEwIchj0fuldD0K7qhUb+bZPlSCi2lJUkhecQv/Jyv2AFalwq/psNh5j3OI9ULuhKvadA2g5eYQ=="}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:13.062491 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-a7fa7bda-1407-42e7-8f5a-7c163bd09a74 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:13.067522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-a7fa7bda-1407-42e7-8f5a-7c163bd09a74 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for user 49c60c4956f8479fbfe93f9f85a8d497 and project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:13.100298 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a7fa7bda-1407-42e7-8f5a-7c163bd09a74 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062874 Jun 07 13:20:13.100974 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 158/326] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:20:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:13.820305 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1a1211c9-b774-4fde-a987-13b84a100377 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:13.820982 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1a1211c9-b774-4fde-a987-13b84a100377 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:13.831688 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1a1211c9-b774-4fde-a987-13b84a100377 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:13.832088 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1a1211c9-b774-4fde-a987-13b84a100377 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:13.836114 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1a1211c9-b774-4fde-a987-13b84a100377 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:13.837789 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1a1211c9-b774-4fde-a987-13b84a100377 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.038144 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1a1211c9-b774-4fde-a987-13b84a100377 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:14.048211 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2ac7e59c-9740-4d2a-9bc2-2db346448320 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:14.049390 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2ac7e59c-9740-4d2a-9bc2-2db346448320 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:14.050321 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1a1211c9-b774-4fde-a987-13b84a100377 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1509 microversion: 2.1 time: 0.233373 Jun 07 13:20:14.051223 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 169/327] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:13 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:14.066136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ac7e59c-9740-4d2a-9bc2-2db346448320 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:14.066636 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ac7e59c-9740-4d2a-9bc2-2db346448320 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.067848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ac7e59c-9740-4d2a-9bc2-2db346448320 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:14.068293 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ac7e59c-9740-4d2a-9bc2-2db346448320 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.221697 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2ac7e59c-9740-4d2a-9bc2-2db346448320 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:14.229424 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2ac7e59c-9740-4d2a-9bc2-2db346448320 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.186285 Jun 07 13:20:14.238408 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 159/328] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:14 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:14.730306 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-a455e9bd-f84e-4446-a1c6-e48ad8bdf9b6 req-5ef4d5ea-5a03-4b20-a900-c689800fe51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dadfca8e-afc3-4687-ba6e-a714b6137139", "tag": "64178e21-d2e4-4fa1-a1cf-21f884b811bc"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:14.739802 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-a455e9bd-f84e-4446-a1c6-e48ad8bdf9b6 req-5ef4d5ea-5a03-4b20-a900-c689800fe51a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:14.740107 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-a455e9bd-f84e-4446-a1c6-e48ad8bdf9b6 req-5ef4d5ea-5a03-4b20-a900-c689800fe51a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.753626 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-a455e9bd-f84e-4446-a1c6-e48ad8bdf9b6 req-5ef4d5ea-5a03-4b20-a900-c689800fe51a service nova] Creating event network-changed:64178e21-d2e4-4fa1-a1cf-21f884b811bc for instance dadfca8e-afc3-4687-ba6e-a714b6137139 on hv-cinder-84460 Jun 07 13:20:14.759750 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-a455e9bd-f84e-4446-a1c6-e48ad8bdf9b6 req-5ef4d5ea-5a03-4b20-a900-c689800fe51a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033024 Jun 07 13:20:14.760979 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 170/329] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:15.072024 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4caa578f-8ac5-48ea-a643-8a78d400ef13 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:15.073446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4caa578f-8ac5-48ea-a643-8a78d400ef13 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:15.090813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4caa578f-8ac5-48ea-a643-8a78d400ef13 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.096648 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4caa578f-8ac5-48ea-a643-8a78d400ef13 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.097646 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4caa578f-8ac5-48ea-a643-8a78d400ef13 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.098101 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4caa578f-8ac5-48ea-a643-8a78d400ef13 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.258405 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3c922aa7-6850-4a59-8b08-01938683f058 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:15.260828 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3c922aa7-6850-4a59-8b08-01938683f058 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:15.277771 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c922aa7-6850-4a59-8b08-01938683f058 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.280523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c922aa7-6850-4a59-8b08-01938683f058 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.285655 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c922aa7-6850-4a59-8b08-01938683f058 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.286114 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c922aa7-6850-4a59-8b08-01938683f058 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.341308 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4caa578f-8ac5-48ea-a643-8a78d400ef13 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:15.379536 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4caa578f-8ac5-48ea-a643-8a78d400ef13 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1509 microversion: 2.1 time: 0.315627 Jun 07 13:20:15.381803 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 160/330] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:15 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:15.432715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1285965086", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7935e13c-3463-4221-bbf4-297a23e61ffb"}], "security_groups": [{"name": "tempest-securitygroup--612638785"}], "key_name": "tempest-keypair-2012735776", "user_data": "}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:15.441252 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:15.545816 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3c922aa7-6850-4a59-8b08-01938683f058 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:15.555099 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3c922aa7-6850-4a59-8b08-01938683f058 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.304723 Jun 07 13:20:15.564696 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 171/331] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:15 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:15.585788 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] validate_networks() for [('7935e13c-3463-4221-bbf4-297a23e61ffb', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:20:15.979819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:20:15.980360 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:20:15.980832 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:20:15.981232 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:20:15.981642 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:20:15.990457 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.990926 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.991717 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.992147 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.008250 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:16.012672 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for user 49c60c4956f8479fbfe93f9f85a8d497 and project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:16.023874 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:20:16.026741 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:20:16.071870 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-251335f1-e4f7-4674-b46c-e741a8088719 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.643534 Jun 07 13:20:16.073077 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 161/332] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:20:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:20:16.082857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fb0fa370-8eec-48fd-84f3-3a5349e4af67 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:16.083612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fb0fa370-8eec-48fd-84f3-3a5349e4af67 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:16.136829 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fb0fa370-8eec-48fd-84f3-3a5349e4af67 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:16.143471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fb0fa370-8eec-48fd-84f3-3a5349e4af67 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1242 microversion: 2.1 time: 0.064391 Jun 07 13:20:16.144012 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 172/333] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:16 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:16.398276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-589afe09-876c-48bf-a185-5737d4dce964 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:16.399173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-589afe09-876c-48bf-a185-5737d4dce964 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:16.405560 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-589afe09-876c-48bf-a185-5737d4dce964 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.406315 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-589afe09-876c-48bf-a185-5737d4dce964 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.407880 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-589afe09-876c-48bf-a185-5737d4dce964 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.408819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-589afe09-876c-48bf-a185-5737d4dce964 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.575078 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b11bb059-64e7-46ef-83b2-4c33256c8b60 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:16.575794 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b11bb059-64e7-46ef-83b2-4c33256c8b60 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:16.588720 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b11bb059-64e7-46ef-83b2-4c33256c8b60 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.590312 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b11bb059-64e7-46ef-83b2-4c33256c8b60 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.591143 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b11bb059-64e7-46ef-83b2-4c33256c8b60 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.591582 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b11bb059-64e7-46ef-83b2-4c33256c8b60 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.606491 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-589afe09-876c-48bf-a185-5737d4dce964 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:16.625241 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-589afe09-876c-48bf-a185-5737d4dce964 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1515 microversion: 2.1 time: 0.231535 Jun 07 13:20:16.625840 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 162/334] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:16 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:16.799920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b11bb059-64e7-46ef-83b2-4c33256c8b60 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:16.809936 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b11bb059-64e7-46ef-83b2-4c33256c8b60 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.242129 Jun 07 13:20:16.810534 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 173/335] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:16 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:17.160977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-aec724e8-dd50-4a63-9126-9899ed390938 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:17.161608 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-aec724e8-dd50-4a63-9126-9899ed390938 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:17.168382 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aec724e8-dd50-4a63-9126-9899ed390938 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.168839 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aec724e8-dd50-4a63-9126-9899ed390938 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.169609 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aec724e8-dd50-4a63-9126-9899ed390938 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.170045 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aec724e8-dd50-4a63-9126-9899ed390938 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.231132 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-aec724e8-dd50-4a63-9126-9899ed390938 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:17.238681 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-aec724e8-dd50-4a63-9126-9899ed390938 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1294 microversion: 2.1 time: 0.081982 Jun 07 13:20:17.239329 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 163/336] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:17 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:17.826393 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7528ae48-5319-4914-8da3-32744b433034 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:17.827185 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7528ae48-5319-4914-8da3-32744b433034 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:17.833693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7528ae48-5319-4914-8da3-32744b433034 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.834149 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7528ae48-5319-4914-8da3-32744b433034 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.834952 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7528ae48-5319-4914-8da3-32744b433034 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.835388 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7528ae48-5319-4914-8da3-32744b433034 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.978252 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7528ae48-5319-4914-8da3-32744b433034 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:17.986638 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7528ae48-5319-4914-8da3-32744b433034 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.163931 Jun 07 13:20:17.988464 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 174/337] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:17 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:18.085973 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c73f1c19-1352-4c6c-9b7e-f6e4ace69463 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'create', calling method: .version_select at 0x7f46a3fea940>, body: {"keypair": {"name": "tempest-keypair-625845876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzw0HMfzlg34MIXlKHleLbT8Ma8Du4dLqXjbAKK0TpI3mVmKdwKt224BE/ZuzuYRsqIafWos2srdOlZezZ36jBhCKMpptX1k4fhjO3xsUGhiomq1w+3m+yzTrEwXcRc/w=="}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:18.102933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-c73f1c19-1352-4c6c-9b7e-f6e4ace69463 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Getting quotas for project 7c615cd1e80a42e0ac2aff126cbb1455. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:18.107127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-c73f1c19-1352-4c6c-9b7e-f6e4ace69463 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Getting quotas for user dcf5286e9ca14f56905e6e247e411896 and project 7c615cd1e80a42e0ac2aff126cbb1455. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:18.130296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c73f1c19-1352-4c6c-9b7e-f6e4ace69463 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048123 Jun 07 13:20:18.131121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 164/338] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:20:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:18.255799 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ff14b670-ab07-4fd6-9972-599400fef846 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:18.257083 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ff14b670-ab07-4fd6-9972-599400fef846 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:18.264486 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ff14b670-ab07-4fd6-9972-599400fef846 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:18.265315 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ff14b670-ab07-4fd6-9972-599400fef846 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:18.266465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ff14b670-ab07-4fd6-9972-599400fef846 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:18.267242 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ff14b670-ab07-4fd6-9972-599400fef846 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:18.498260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ff14b670-ab07-4fd6-9972-599400fef846 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:18.503049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=100 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:18.509333 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ff14b670-ab07-4fd6-9972-599400fef846 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1294 microversion: 2.1 time: 0.256526 Jun 07 13:20:18.510606 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 175/339] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:18 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1294 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:19.003999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c89964fa-6148-4c75-8cf1-35035068818c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:19.004616 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c89964fa-6148-4c75-8cf1-35035068818c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:19.014075 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c89964fa-6148-4c75-8cf1-35035068818c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:19.015102 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c89964fa-6148-4c75-8cf1-35035068818c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:19.016430 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c89964fa-6148-4c75-8cf1-35035068818c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:19.017305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c89964fa-6148-4c75-8cf1-35035068818c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:19.246320 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c89964fa-6148-4c75-8cf1-35035068818c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:19.254447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c89964fa-6148-4c75-8cf1-35035068818c tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.254258 Jun 07 13:20:19.255150 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 165/340] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:18 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:19.527329 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6229a27b-66e8-4d40-8fb0-ccb8b064ccf0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:19.527942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6229a27b-66e8-4d40-8fb0-ccb8b064ccf0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:19.535984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6229a27b-66e8-4d40-8fb0-ccb8b064ccf0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:19.540487 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6229a27b-66e8-4d40-8fb0-ccb8b064ccf0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:19.543604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6229a27b-66e8-4d40-8fb0-ccb8b064ccf0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:19.544378 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6229a27b-66e8-4d40-8fb0-ccb8b064ccf0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:19.680272 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6229a27b-66e8-4d40-8fb0-ccb8b064ccf0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:19.689627 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6229a27b-66e8-4d40-8fb0-ccb8b064ccf0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1300 microversion: 2.1 time: 0.166672 Jun 07 13:20:19.690801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 176/341] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:19 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1300 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:20.273535 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-929d3111-f188-408c-84ff-2d3a4c117fce tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:20.275027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-929d3111-f188-408c-84ff-2d3a4c117fce tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:20.296328 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-929d3111-f188-408c-84ff-2d3a4c117fce tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:20.296792 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-929d3111-f188-408c-84ff-2d3a4c117fce tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:20.297952 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-929d3111-f188-408c-84ff-2d3a4c117fce tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:20.298568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-929d3111-f188-408c-84ff-2d3a4c117fce tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:20.317752 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1896895939", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f37998a8-ef40-428e-a125-520797faa6c7"}], "security_groups": [{"name": "tempest-securitygroup--1705350734"}], "key_name": "tempest-keypair-625845876", "user_data": "}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:20.515307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] validate_networks() for [('f37998a8-ef40-428e-a125-520797faa6c7', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:20:20.709647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-929d3111-f188-408c-84ff-2d3a4c117fce tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:20.717795 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-929d3111-f188-408c-84ff-2d3a4c117fce tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.449574 Jun 07 13:20:20.718377 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 166/342] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:20 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:20.731210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-94f62a1d-523c-42b3-b176-dea46dbd3350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:20.732160 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-94f62a1d-523c-42b3-b176-dea46dbd3350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:20.744637 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94f62a1d-523c-42b3-b176-dea46dbd3350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:20.748631 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94f62a1d-523c-42b3-b176-dea46dbd3350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:20.750779 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94f62a1d-523c-42b3-b176-dea46dbd3350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:20.751686 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94f62a1d-523c-42b3-b176-dea46dbd3350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:21.068985 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-94f62a1d-523c-42b3-b176-dea46dbd3350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:21.077282 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-94f62a1d-523c-42b3-b176-dea46dbd3350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.353218 Jun 07 13:20:21.077873 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 167/343] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:20 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:21.194980 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:20:21.195485 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:20:21.196597 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:20:21.197223 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:20:21.198340 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:20:21.214243 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:21.214919 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:21.215926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:21.216792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:21.240933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Getting quotas for project 7c615cd1e80a42e0ac2aff126cbb1455. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:21.246789 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Getting quotas for user dcf5286e9ca14f56905e6e247e411896 and project 7c615cd1e80a42e0ac2aff126cbb1455. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:21.262779 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:20:21.279755 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:20:21.361322 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-78607653-9d4d-4db5-a7af-8d050c9b5699 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.049147 Jun 07 13:20:21.362940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 177/344] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:20:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:20:21.373022 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f56b97ea-0426-4d9e-8988-cf02beb43514 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:21.374385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f56b97ea-0426-4d9e-8988-cf02beb43514 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:21.650206 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f56b97ea-0426-4d9e-8988-cf02beb43514 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:21.668618 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f56b97ea-0426-4d9e-8988-cf02beb43514 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1245 microversion: 2.1 time: 0.299647 Jun 07 13:20:21.670434 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 168/345] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:21 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1245 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:21.754568 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4c2a86f7-06f7-46f8-8721-28d52bfdaeb8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:21.756319 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4c2a86f7-06f7-46f8-8721-28d52bfdaeb8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:21.778109 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4c2a86f7-06f7-46f8-8721-28d52bfdaeb8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:21.780506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4c2a86f7-06f7-46f8-8721-28d52bfdaeb8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:21.785390 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4c2a86f7-06f7-46f8-8721-28d52bfdaeb8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:21.786037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4c2a86f7-06f7-46f8-8721-28d52bfdaeb8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:21.992978 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4c2a86f7-06f7-46f8-8721-28d52bfdaeb8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:22.011605 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4c2a86f7-06f7-46f8-8721-28d52bfdaeb8 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.278932 Jun 07 13:20:22.012339 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 178/346] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:21 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:22.115796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-669f1269-2cc0-4356-a65c-061710e676f9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:22.116689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-669f1269-2cc0-4356-a65c-061710e676f9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:22.131114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-669f1269-2cc0-4356-a65c-061710e676f9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.131886 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-669f1269-2cc0-4356-a65c-061710e676f9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.132832 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-669f1269-2cc0-4356-a65c-061710e676f9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.134253 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-669f1269-2cc0-4356-a65c-061710e676f9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.338193 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-669f1269-2cc0-4356-a65c-061710e676f9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:22.349390 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-669f1269-2cc0-4356-a65c-061710e676f9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.255110 Jun 07 13:20:22.349986 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 169/347] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:22 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:22.404898 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-95ad5fbb-92fd-47f1-a4f5-ec5b03f60104 req-a825cda8-7a3b-44a1-abb6-deacff086291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20833de2-a8ed-47e0-a402-7d2c367a5fe5", "tag": "e03bee43-ba5c-48ca-bb29-489689c6a119"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:22.420507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-95ad5fbb-92fd-47f1-a4f5-ec5b03f60104 req-a825cda8-7a3b-44a1-abb6-deacff086291 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.420969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-95ad5fbb-92fd-47f1-a4f5-ec5b03f60104 req-a825cda8-7a3b-44a1-abb6-deacff086291 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.450333 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-95ad5fbb-92fd-47f1-a4f5-ec5b03f60104 req-a825cda8-7a3b-44a1-abb6-deacff086291 service nova] Creating event network-changed:e03bee43-ba5c-48ca-bb29-489689c6a119 for instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 on hv-cinder-84460 Jun 07 13:20:22.456793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-95ad5fbb-92fd-47f1-a4f5-ec5b03f60104 req-a825cda8-7a3b-44a1-abb6-deacff086291 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057192 Jun 07 13:20:22.457867 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 179/348] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:22.694244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5ea5ad0d-7fe0-428f-b0e2-a3ec4d16e9e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:22.695863 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5ea5ad0d-7fe0-428f-b0e2-a3ec4d16e9e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:22.710902 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5ea5ad0d-7fe0-428f-b0e2-a3ec4d16e9e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.712583 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5ea5ad0d-7fe0-428f-b0e2-a3ec4d16e9e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.714219 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5ea5ad0d-7fe0-428f-b0e2-a3ec4d16e9e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.714677 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5ea5ad0d-7fe0-428f-b0e2-a3ec4d16e9e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.811985 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5ea5ad0d-7fe0-428f-b0e2-a3ec4d16e9e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:22.833743 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5ea5ad0d-7fe0-428f-b0e2-a3ec4d16e9e9 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1297 microversion: 2.1 time: 0.148536 Jun 07 13:20:22.834794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 170/349] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:22 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1297 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:22.900653 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-f139f2a8-c8ec-4499-8143-e33b0d9a7046 req-f138a66b-ff0f-46c0-a525-a19f949fc246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadfca8e-afc3-4687-ba6e-a714b6137139", "name": "network-vif-plugged", "status": "completed", "tag": "64178e21-d2e4-4fa1-a1cf-21f884b811bc"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:22.917423 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f139f2a8-c8ec-4499-8143-e33b0d9a7046 req-f138a66b-ff0f-46c0-a525-a19f949fc246 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.918210 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f139f2a8-c8ec-4499-8143-e33b0d9a7046 req-f138a66b-ff0f-46c0-a525-a19f949fc246 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.945166 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-f139f2a8-c8ec-4499-8143-e33b0d9a7046 req-f138a66b-ff0f-46c0-a525-a19f949fc246 service nova] Creating event network-vif-plugged:64178e21-d2e4-4fa1-a1cf-21f884b811bc for instance dadfca8e-afc3-4687-ba6e-a714b6137139 on hv-cinder-84460 Jun 07 13:20:22.951630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-f139f2a8-c8ec-4499-8143-e33b0d9a7046 req-f138a66b-ff0f-46c0-a525-a19f949fc246 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055217 Jun 07 13:20:22.952843 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 180/350] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:23.057051 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-76d4f85d-4ed4-4500-b8c4-e09e3c3733d0 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:23.057051 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-76d4f85d-4ed4-4500-b8c4-e09e3c3733d0 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:23.069764 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76d4f85d-4ed4-4500-b8c4-e09e3c3733d0 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.070664 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76d4f85d-4ed4-4500-b8c4-e09e3c3733d0 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:23.072901 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76d4f85d-4ed4-4500-b8c4-e09e3c3733d0 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.073720 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76d4f85d-4ed4-4500-b8c4-e09e3c3733d0 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:23.302779 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-76d4f85d-4ed4-4500-b8c4-e09e3c3733d0 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:23.312641 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-76d4f85d-4ed4-4500-b8c4-e09e3c3733d0 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.275155 Jun 07 13:20:23.313327 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 171/351] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:23 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:23.366693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4329e76d-36af-4189-8d9d-6edd53664fad tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:23.367607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4329e76d-36af-4189-8d9d-6edd53664fad tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:23.387908 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4329e76d-36af-4189-8d9d-6edd53664fad tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.390043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4329e76d-36af-4189-8d9d-6edd53664fad tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:23.391845 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4329e76d-36af-4189-8d9d-6edd53664fad tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.393918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4329e76d-36af-4189-8d9d-6edd53664fad tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:23.647863 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4329e76d-36af-4189-8d9d-6edd53664fad tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:23.657538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4329e76d-36af-4189-8d9d-6edd53664fad tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.295600 Jun 07 13:20:23.658130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 181/352] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:23 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:23.852038 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-53b6fb4d-ec84-4242-a2d7-8b979fd1a3cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:23.853253 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-53b6fb4d-ec84-4242-a2d7-8b979fd1a3cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:23.869299 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-53b6fb4d-ec84-4242-a2d7-8b979fd1a3cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.869860 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-53b6fb4d-ec84-4242-a2d7-8b979fd1a3cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:23.870710 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-53b6fb4d-ec84-4242-a2d7-8b979fd1a3cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.882141 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-53b6fb4d-ec84-4242-a2d7-8b979fd1a3cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:23.969990 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-53b6fb4d-ec84-4242-a2d7-8b979fd1a3cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:23.983185 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-53b6fb4d-ec84-4242-a2d7-8b979fd1a3cc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1303 microversion: 2.1 time: 0.134724 Jun 07 13:20:23.984594 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 172/353] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:23 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:24.330523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-225fb4c0-d013-413d-b3d6-a996412b7733 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:24.331537 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-225fb4c0-d013-413d-b3d6-a996412b7733 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:24.338330 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-225fb4c0-d013-413d-b3d6-a996412b7733 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:24.339128 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-225fb4c0-d013-413d-b3d6-a996412b7733 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:24.340157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-225fb4c0-d013-413d-b3d6-a996412b7733 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:24.340876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-225fb4c0-d013-413d-b3d6-a996412b7733 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:24.597231 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-225fb4c0-d013-413d-b3d6-a996412b7733 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:24.608978 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-225fb4c0-d013-413d-b3d6-a996412b7733 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.282533 Jun 07 13:20:24.619119 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 182/354] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:24 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:24.684079 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-991ef840-f6dd-446c-a7c2-8bb94fdc63f1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:24.685056 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-991ef840-f6dd-446c-a7c2-8bb94fdc63f1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:24.692087 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-991ef840-f6dd-446c-a7c2-8bb94fdc63f1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:24.692469 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-991ef840-f6dd-446c-a7c2-8bb94fdc63f1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:24.693293 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-991ef840-f6dd-446c-a7c2-8bb94fdc63f1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:24.695063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-991ef840-f6dd-446c-a7c2-8bb94fdc63f1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:25.007914 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1ca83d33-72ac-4bad-af8c-f7a98da53a23 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:25.009108 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1ca83d33-72ac-4bad-af8c-f7a98da53a23 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:25.028569 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ca83d33-72ac-4bad-af8c-f7a98da53a23 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:25.029352 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ca83d33-72ac-4bad-af8c-f7a98da53a23 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:25.030351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ca83d33-72ac-4bad-af8c-f7a98da53a23 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:25.035004 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ca83d33-72ac-4bad-af8c-f7a98da53a23 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:25.309151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-991ef840-f6dd-446c-a7c2-8bb94fdc63f1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:25.318795 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-991ef840-f6dd-446c-a7c2-8bb94fdc63f1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.647602 Jun 07 13:20:25.326900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 173/355] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:24 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:25.394383 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1ca83d33-72ac-4bad-af8c-f7a98da53a23 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:25.403751 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1ca83d33-72ac-4bad-af8c-f7a98da53a23 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.406599 Jun 07 13:20:25.404342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 183/356] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:24 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:25.630331 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-41100a46-9917-4554-9d82-b1692bc4a592 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:25.631005 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-41100a46-9917-4554-9d82-b1692bc4a592 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:25.638680 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-41100a46-9917-4554-9d82-b1692bc4a592 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:25.639508 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-41100a46-9917-4554-9d82-b1692bc4a592 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:25.639945 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-41100a46-9917-4554-9d82-b1692bc4a592 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:25.640388 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-41100a46-9917-4554-9d82-b1692bc4a592 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:25.905507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-85469263-bcc9-4311-8554-0292ba99014f req-75a9071d-0ffb-4c04-8cda-5c01ae054089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb5d9cf-92eb-45b1-b8b5-73af66067558", "tag": "541e0200-55c0-4b40-a06e-d6fcf5d21cf5"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:25.936382 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-41100a46-9917-4554-9d82-b1692bc4a592 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:25.940285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-85469263-bcc9-4311-8554-0292ba99014f req-75a9071d-0ffb-4c04-8cda-5c01ae054089 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:25.943287 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-85469263-bcc9-4311-8554-0292ba99014f req-75a9071d-0ffb-4c04-8cda-5c01ae054089 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:25.958245 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-41100a46-9917-4554-9d82-b1692bc4a592 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.336367 Jun 07 13:20:25.959743 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 174/357] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:25 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:25.976054 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-85469263-bcc9-4311-8554-0292ba99014f req-75a9071d-0ffb-4c04-8cda-5c01ae054089 service nova] Creating event network-changed:541e0200-55c0-4b40-a06e-d6fcf5d21cf5 for instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 on hv-cinder-84460 Jun 07 13:20:25.988038 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-85469263-bcc9-4311-8554-0292ba99014f req-75a9071d-0ffb-4c04-8cda-5c01ae054089 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099859 Jun 07 13:20:25.988639 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 184/358] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:26.337919 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-32f0387f-8397-46c4-be0f-ce212056ae4d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:26.340449 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-32f0387f-8397-46c4-be0f-ce212056ae4d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:26.342740 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=4 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:26.348749 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-32f0387f-8397-46c4-be0f-ce212056ae4d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:26.349719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-32f0387f-8397-46c4-be0f-ce212056ae4d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:26.350745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-32f0387f-8397-46c4-be0f-ce212056ae4d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:26.351443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-32f0387f-8397-46c4-be0f-ce212056ae4d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:26.356210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:26.426363 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-46a604b0-5235-40e9-91e3-58cede2d1022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:26.428617 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-46a604b0-5235-40e9-91e3-58cede2d1022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:26.437525 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-46a604b0-5235-40e9-91e3-58cede2d1022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:26.438322 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-46a604b0-5235-40e9-91e3-58cede2d1022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:26.439187 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-46a604b0-5235-40e9-91e3-58cede2d1022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:26.439646 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-46a604b0-5235-40e9-91e3-58cede2d1022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:26.671702 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-32f0387f-8397-46c4-be0f-ce212056ae4d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:26.683220 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-32f0387f-8397-46c4-be0f-ce212056ae4d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.349483 Jun 07 13:20:26.683930 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 175/359] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:26 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:26.706546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-46a604b0-5235-40e9-91e3-58cede2d1022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:26.714754 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-46a604b0-5235-40e9-91e3-58cede2d1022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.297624 Jun 07 13:20:26.715420 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 185/360] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:26 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:26.975561 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-19dfd123-38ef-4e95-9510-db1b612325fe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:26.976170 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-19dfd123-38ef-4e95-9510-db1b612325fe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:26.982572 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-19dfd123-38ef-4e95-9510-db1b612325fe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:26.983061 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-19dfd123-38ef-4e95-9510-db1b612325fe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:26.983824 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-19dfd123-38ef-4e95-9510-db1b612325fe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:26.984253 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-19dfd123-38ef-4e95-9510-db1b612325fe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:27.122649 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-19dfd123-38ef-4e95-9510-db1b612325fe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:27.130655 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-19dfd123-38ef-4e95-9510-db1b612325fe tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.159003 Jun 07 13:20:27.141024 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 176/361] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:26 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:27.704044 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c26efeea-a019-459e-a205-778d2d560dde tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:27.704700 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c26efeea-a019-459e-a205-778d2d560dde tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:27.712016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c26efeea-a019-459e-a205-778d2d560dde tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:27.712472 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c26efeea-a019-459e-a205-778d2d560dde tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:27.713246 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c26efeea-a019-459e-a205-778d2d560dde tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:27.713683 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c26efeea-a019-459e-a205-778d2d560dde tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:27.732875 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c5fd597d-bcdd-4c61-b6b7-c49072cc6e16 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:27.734160 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c5fd597d-bcdd-4c61-b6b7-c49072cc6e16 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:27.742302 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c5fd597d-bcdd-4c61-b6b7-c49072cc6e16 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:27.743287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c5fd597d-bcdd-4c61-b6b7-c49072cc6e16 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:27.744401 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c5fd597d-bcdd-4c61-b6b7-c49072cc6e16 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:27.745636 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c5fd597d-bcdd-4c61-b6b7-c49072cc6e16 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:27.944273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c26efeea-a019-459e-a205-778d2d560dde tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:27.964578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c26efeea-a019-459e-a205-778d2d560dde tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.268161 Jun 07 13:20:27.966256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 186/362] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:27 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:27.971094 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c5fd597d-bcdd-4c61-b6b7-c49072cc6e16 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:27.982571 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c5fd597d-bcdd-4c61-b6b7-c49072cc6e16 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.254239 Jun 07 13:20:27.983504 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 177/363] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:27 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:28.148869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c6d60f18-60cd-46fa-b632-a8e7b2a9c519 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:28.149517 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c6d60f18-60cd-46fa-b632-a8e7b2a9c519 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:28.157107 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c6d60f18-60cd-46fa-b632-a8e7b2a9c519 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:28.157769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c6d60f18-60cd-46fa-b632-a8e7b2a9c519 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:28.158567 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c6d60f18-60cd-46fa-b632-a8e7b2a9c519 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:28.159064 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c6d60f18-60cd-46fa-b632-a8e7b2a9c519 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:28.323348 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c6d60f18-60cd-46fa-b632-a8e7b2a9c519 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:28.330774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c6d60f18-60cd-46fa-b632-a8e7b2a9c519 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.186046 Jun 07 13:20:28.331720 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 187/364] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:28 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:28.982585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-330b1e3a-7e37-42f4-8ac1-6bc8cbe540b7 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:28.983227 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-330b1e3a-7e37-42f4-8ac1-6bc8cbe540b7 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:28.991298 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-330b1e3a-7e37-42f4-8ac1-6bc8cbe540b7 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:28.991938 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-330b1e3a-7e37-42f4-8ac1-6bc8cbe540b7 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:28.992877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-330b1e3a-7e37-42f4-8ac1-6bc8cbe540b7 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:28.993471 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-330b1e3a-7e37-42f4-8ac1-6bc8cbe540b7 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.000956 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3daed4a7-2462-484f-ac7f-4e4d10b6e71c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:29.002169 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3daed4a7-2462-484f-ac7f-4e4d10b6e71c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:29.018941 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3daed4a7-2462-484f-ac7f-4e4d10b6e71c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.019619 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3daed4a7-2462-484f-ac7f-4e4d10b6e71c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.020439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3daed4a7-2462-484f-ac7f-4e4d10b6e71c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.031204 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3daed4a7-2462-484f-ac7f-4e4d10b6e71c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.265713 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3daed4a7-2462-484f-ac7f-4e4d10b6e71c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:29.275385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3daed4a7-2462-484f-ac7f-4e4d10b6e71c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.278609 Jun 07 13:20:29.279808 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 188/365] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:28 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:29.317054 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-330b1e3a-7e37-42f4-8ac1-6bc8cbe540b7 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:29.328207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-330b1e3a-7e37-42f4-8ac1-6bc8cbe540b7 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.350224 Jun 07 13:20:29.340378 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 178/366] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:28 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:29.348631 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-430aaa0c-c5ea-40fa-a79f-da68a0dd67cf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:29.349755 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-430aaa0c-c5ea-40fa-a79f-da68a0dd67cf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:29.359444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-430aaa0c-c5ea-40fa-a79f-da68a0dd67cf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.360282 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-430aaa0c-c5ea-40fa-a79f-da68a0dd67cf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.363906 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-430aaa0c-c5ea-40fa-a79f-da68a0dd67cf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.364490 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-430aaa0c-c5ea-40fa-a79f-da68a0dd67cf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.543432 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-430aaa0c-c5ea-40fa-a79f-da68a0dd67cf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:29.552776 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-430aaa0c-c5ea-40fa-a79f-da68a0dd67cf tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1313 microversion: 2.1 time: 0.208053 Jun 07 13:20:29.553933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 189/367] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:29 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:30.299097 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-10a9d5cf-e968-4aed-a54d-5ea120bf6008 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:30.299937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-10a9d5cf-e968-4aed-a54d-5ea120bf6008 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:30.312371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10a9d5cf-e968-4aed-a54d-5ea120bf6008 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:30.315720 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10a9d5cf-e968-4aed-a54d-5ea120bf6008 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:30.316760 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10a9d5cf-e968-4aed-a54d-5ea120bf6008 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:30.321371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10a9d5cf-e968-4aed-a54d-5ea120bf6008 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:30.346768 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3e0eea23-b613-4c5b-b11a-a70ec012b9ab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:30.347644 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3e0eea23-b613-4c5b-b11a-a70ec012b9ab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:30.354983 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e0eea23-b613-4c5b-b11a-a70ec012b9ab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:30.355443 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e0eea23-b613-4c5b-b11a-a70ec012b9ab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:30.372022 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e0eea23-b613-4c5b-b11a-a70ec012b9ab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:30.372484 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e0eea23-b613-4c5b-b11a-a70ec012b9ab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:30.945933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-10a9d5cf-e968-4aed-a54d-5ea120bf6008 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:30.951999 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3e0eea23-b613-4c5b-b11a-a70ec012b9ab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:30.965143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-10a9d5cf-e968-4aed-a54d-5ea120bf6008 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.672774 Jun 07 13:20:30.969593 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3e0eea23-b613-4c5b-b11a-a70ec012b9ab tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.626327 Jun 07 13:20:30.971186 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 179/368] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:30 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:30.976469 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 190/369] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:30 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:30.982394 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-88cf6386-e2ec-47f4-93ae-cc8e3e638481 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:30.983320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-88cf6386-e2ec-47f4-93ae-cc8e3e638481 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:30.990166 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-88cf6386-e2ec-47f4-93ae-cc8e3e638481 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:30.990954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-88cf6386-e2ec-47f4-93ae-cc8e3e638481 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:30.991960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-88cf6386-e2ec-47f4-93ae-cc8e3e638481 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:30.992638 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-88cf6386-e2ec-47f4-93ae-cc8e3e638481 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:31.229737 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:31.257223 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=10 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:31.513453 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-88cf6386-e2ec-47f4-93ae-cc8e3e638481 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:31.524460 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-88cf6386-e2ec-47f4-93ae-cc8e3e638481 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1497 microversion: 2.1 time: 0.546511 Jun 07 13:20:31.538354 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 191/370] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:30 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1497 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:31.994561 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9ceb2263-2c1c-4e75-a8f6-a0b5afcf172e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:31.995415 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ca366a4e-cca7-4d9c-a377-091e7fc4ec80 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:31.996044 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ca366a4e-cca7-4d9c-a377-091e7fc4ec80 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:31.996968 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9ceb2263-2c1c-4e75-a8f6-a0b5afcf172e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:32.002709 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=22 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:32.024384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ca366a4e-cca7-4d9c-a377-091e7fc4ec80 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.027669 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ca366a4e-cca7-4d9c-a377-091e7fc4ec80 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.029911 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9ceb2263-2c1c-4e75-a8f6-a0b5afcf172e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.031331 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ca366a4e-cca7-4d9c-a377-091e7fc4ec80 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.032329 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ca366a4e-cca7-4d9c-a377-091e7fc4ec80 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.038785 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9ceb2263-2c1c-4e75-a8f6-a0b5afcf172e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.048773 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9ceb2263-2c1c-4e75-a8f6-a0b5afcf172e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.049286 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9ceb2263-2c1c-4e75-a8f6-a0b5afcf172e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.529085 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9ceb2263-2c1c-4e75-a8f6-a0b5afcf172e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:32.550292 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9ceb2263-2c1c-4e75-a8f6-a0b5afcf172e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.565055 Jun 07 13:20:32.554874 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 180/371] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:31 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:32.557475 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9ea25e6b-e400-4182-ade2-f060b242d3c1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:32.557975 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9ea25e6b-e400-4182-ade2-f060b242d3c1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:32.564053 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ca366a4e-cca7-4d9c-a377-091e7fc4ec80 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:32.574215 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ca366a4e-cca7-4d9c-a377-091e7fc4ec80 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.586378 Jun 07 13:20:32.574795 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 192/372] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:31 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:32.597482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9ea25e6b-e400-4182-ade2-f060b242d3c1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.599156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9ea25e6b-e400-4182-ade2-f060b242d3c1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.601258 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9ea25e6b-e400-4182-ade2-f060b242d3c1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.602953 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9ea25e6b-e400-4182-ade2-f060b242d3c1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.648013 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9ea25e6b-e400-4182-ade2-f060b242d3c1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Going to try to terminate instance {{(pid=117842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:20:32.814752 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9ea25e6b-e400-4182-ade2-f060b242d3c1 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 204 len: 0 microversion: 2.1 time: 0.260969 Jun 07 13:20:32.821263 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 181/373] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:20:32 2022] DELETE /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:20:32.829974 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-968e4e1d-9a50-423d-af9c-c134626ccc5a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:32.830584 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-968e4e1d-9a50-423d-af9c-c134626ccc5a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:32.837097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-968e4e1d-9a50-423d-af9c-c134626ccc5a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.837549 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-968e4e1d-9a50-423d-af9c-c134626ccc5a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.838407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-968e4e1d-9a50-423d-af9c-c134626ccc5a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.838858 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-968e4e1d-9a50-423d-af9c-c134626ccc5a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.082106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-968e4e1d-9a50-423d-af9c-c134626ccc5a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:33.090228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-968e4e1d-9a50-423d-af9c-c134626ccc5a tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1503 microversion: 2.1 time: 0.263999 Jun 07 13:20:33.091064 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 193/374] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:32 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:33.571463 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f7ebcf71-c0a4-4b1d-95c5-b28b8c4fd726 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:33.572173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f7ebcf71-c0a4-4b1d-95c5-b28b8c4fd726 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:33.582902 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f7ebcf71-c0a4-4b1d-95c5-b28b8c4fd726 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.584343 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f7ebcf71-c0a4-4b1d-95c5-b28b8c4fd726 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.585420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f7ebcf71-c0a4-4b1d-95c5-b28b8c4fd726 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.593676 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-613d2106-a63d-441d-9bca-49de8a265550 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:33.595245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-613d2106-a63d-441d-9bca-49de8a265550 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:33.612476 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f7ebcf71-c0a4-4b1d-95c5-b28b8c4fd726 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.623784 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-613d2106-a63d-441d-9bca-49de8a265550 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.627814 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-613d2106-a63d-441d-9bca-49de8a265550 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.628628 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-613d2106-a63d-441d-9bca-49de8a265550 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.629067 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-613d2106-a63d-441d-9bca-49de8a265550 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.889925 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f7ebcf71-c0a4-4b1d-95c5-b28b8c4fd726 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:33.907611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-613d2106-a63d-441d-9bca-49de8a265550 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:33.916076 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-613d2106-a63d-441d-9bca-49de8a265550 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.328155 Jun 07 13:20:33.917607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 194/375] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:33 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:33.930017 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f7ebcf71-c0a4-4b1d-95c5-b28b8c4fd726 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.363609 Jun 07 13:20:33.931105 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 182/376] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:33 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:34.116803 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8d4d8c12-a09e-4f7e-976e-7b516a713b49 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:34.117414 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8d4d8c12-a09e-4f7e-976e-7b516a713b49 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:34.125332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d4d8c12-a09e-4f7e-976e-7b516a713b49 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.126297 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d4d8c12-a09e-4f7e-976e-7b516a713b49 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.130174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d4d8c12-a09e-4f7e-976e-7b516a713b49 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.130916 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d4d8c12-a09e-4f7e-976e-7b516a713b49 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.221721 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f2293786-aa97-4448-b213-177d5364bd15 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Action: 'create', calling method: .version_select at 0x7f46a802ad30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1670039504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzfQi9lm9HkqhsUYt4giPPepxJo+BI+/fMLQVQsoqoA8W/xrIKyd3Me3HUdHEySuJqpdrXzQr2DFqU+19hBSuFuYn1nJnOI2GfLQQ4hi9KAJJLPHVI7T+S4sGSjwWICag=="}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:34.240101 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-f2293786-aa97-4448-b213-177d5364bd15 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Getting quotas for project b562a09561af4197bf2835b31a9dd34e. Resources: {'key_pairs'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:34.246454 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-f2293786-aa97-4448-b213-177d5364bd15 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Getting quotas for user 36c5458a18f146be87207e0f6dd598eb and project b562a09561af4197bf2835b31a9dd34e. Resources: {'key_pairs'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:34.286307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f2293786-aa97-4448-b213-177d5364bd15 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.367635 Jun 07 13:20:34.286929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 195/377] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:20:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:34.329399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8d4d8c12-a09e-4f7e-976e-7b516a713b49 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:34.341232 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8d4d8c12-a09e-4f7e-976e-7b516a713b49 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1503 microversion: 2.1 time: 0.228097 Jun 07 13:20:34.342723 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 183/378] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:34 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:34.935951 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d4ac50d7-6f00-44c7-afe6-7171e743f681 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:34.937285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d4ac50d7-6f00-44c7-afe6-7171e743f681 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:34.946155 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d4ac50d7-6f00-44c7-afe6-7171e743f681 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.946657 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d4ac50d7-6f00-44c7-afe6-7171e743f681 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.948241 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d4ac50d7-6f00-44c7-afe6-7171e743f681 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.948904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0ef087e1-0438-4316-a316-f0c8e9731db1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:34.949360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d4ac50d7-6f00-44c7-afe6-7171e743f681 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.949617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0ef087e1-0438-4316-a316-f0c8e9731db1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:34.954019 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=100 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:34.967004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ef087e1-0438-4316-a316-f0c8e9731db1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.967467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ef087e1-0438-4316-a316-f0c8e9731db1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.968252 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ef087e1-0438-4316-a316-f0c8e9731db1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.968687 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ef087e1-0438-4316-a316-f0c8e9731db1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:35.184533 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0ef087e1-0438-4316-a316-f0c8e9731db1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:35.195953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d4ac50d7-6f00-44c7-afe6-7171e743f681 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:35.202540 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0ef087e1-0438-4316-a316-f0c8e9731db1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.258695 Jun 07 13:20:35.206951 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d4ac50d7-6f00-44c7-afe6-7171e743f681 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.276855 Jun 07 13:20:35.207746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 184/379] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:34 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:35.216604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 196/380] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:34 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:35.359766 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1b0d9c90-5cff-41a2-b201-20fe43696148 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:35.360628 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1b0d9c90-5cff-41a2-b201-20fe43696148 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:35.368739 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1b0d9c90-5cff-41a2-b201-20fe43696148 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:35.369447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1b0d9c90-5cff-41a2-b201-20fe43696148 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:35.370922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1b0d9c90-5cff-41a2-b201-20fe43696148 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:35.371530 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1b0d9c90-5cff-41a2-b201-20fe43696148 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:35.557942 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1b0d9c90-5cff-41a2-b201-20fe43696148 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:35.568416 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1b0d9c90-5cff-41a2-b201-20fe43696148 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1503 microversion: 2.1 time: 0.212271 Jun 07 13:20:35.574874 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 185/381] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:35 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:36.223659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-992097d9-9f1d-4337-a9f6-8a18ec46af58 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:36.225199 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-992097d9-9f1d-4337-a9f6-8a18ec46af58 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:36.236211 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7573990a-0f6c-47a7-af67-609613098a55 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:36.237447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-992097d9-9f1d-4337-a9f6-8a18ec46af58 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.238737 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-7573990a-0f6c-47a7-af67-609613098a55 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:36.242318 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-992097d9-9f1d-4337-a9f6-8a18ec46af58 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.244036 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-992097d9-9f1d-4337-a9f6-8a18ec46af58 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.244627 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-992097d9-9f1d-4337-a9f6-8a18ec46af58 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.247494 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7573990a-0f6c-47a7-af67-609613098a55 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.248134 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7573990a-0f6c-47a7-af67-609613098a55 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.248911 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7573990a-0f6c-47a7-af67-609613098a55 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.249513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7573990a-0f6c-47a7-af67-609613098a55 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.508433 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-992097d9-9f1d-4337-a9f6-8a18ec46af58 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:36.528649 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-992097d9-9f1d-4337-a9f6-8a18ec46af58 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.308596 Jun 07 13:20:36.530511 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 197/382] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:36 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:36.536377 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-3deade9f-8966-452a-8043-6667be80aa85 req-ed9f0688-e5d6-47bc-98fa-d12f57458789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20833de2-a8ed-47e0-a402-7d2c367a5fe5", "name": "network-vif-plugged", "status": "completed", "tag": "e03bee43-ba5c-48ca-bb29-489689c6a119"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:36.544537 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7573990a-0f6c-47a7-af67-609613098a55 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:36.553150 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-3deade9f-8966-452a-8043-6667be80aa85 req-ed9f0688-e5d6-47bc-98fa-d12f57458789 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.554478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-3deade9f-8966-452a-8043-6667be80aa85 req-ed9f0688-e5d6-47bc-98fa-d12f57458789 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.556471 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7573990a-0f6c-47a7-af67-609613098a55 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.326591 Jun 07 13:20:36.559551 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 186/383] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:36 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:36.570481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-3deade9f-8966-452a-8043-6667be80aa85 req-ed9f0688-e5d6-47bc-98fa-d12f57458789 service nova] Creating event network-vif-plugged:e03bee43-ba5c-48ca-bb29-489689c6a119 for instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 on hv-cinder-84460 Jun 07 13:20:36.580776 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-3deade9f-8966-452a-8043-6667be80aa85 req-ed9f0688-e5d6-47bc-98fa-d12f57458789 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048805 Jun 07 13:20:36.581770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 198/384] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:36.589449 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3920da52-0dc1-40d7-a2a5-5a19b1791355 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:36.591398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3920da52-0dc1-40d7-a2a5-5a19b1791355 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:36.621859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3920da52-0dc1-40d7-a2a5-5a19b1791355 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.623169 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3920da52-0dc1-40d7-a2a5-5a19b1791355 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.624711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3920da52-0dc1-40d7-a2a5-5a19b1791355 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.625322 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3920da52-0dc1-40d7-a2a5-5a19b1791355 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.681438 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-b660592d-8c16-4a56-b508-fb28f6751968 req-4d53fc3c-0075-4d5e-aa72-b348c45ed7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadfca8e-afc3-4687-ba6e-a714b6137139", "name": "network-vif-deleted", "tag": "64178e21-d2e4-4fa1-a1cf-21f884b811bc"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:36.714229 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-b660592d-8c16-4a56-b508-fb28f6751968 req-4d53fc3c-0075-4d5e-aa72-b348c45ed7b9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.714875 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-b660592d-8c16-4a56-b508-fb28f6751968 req-4d53fc3c-0075-4d5e-aa72-b348c45ed7b9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.726771 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-b660592d-8c16-4a56-b508-fb28f6751968 req-4d53fc3c-0075-4d5e-aa72-b348c45ed7b9 service nova] Creating event network-vif-deleted:64178e21-d2e4-4fa1-a1cf-21f884b811bc for instance dadfca8e-afc3-4687-ba6e-a714b6137139 on hv-cinder-84460 Jun 07 13:20:36.736642 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-b660592d-8c16-4a56-b508-fb28f6751968 req-4d53fc3c-0075-4d5e-aa72-b348c45ed7b9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071236 Jun 07 13:20:36.737562 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 199/385] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:36.783108 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-3920da52-0dc1-40d7-a2a5-5a19b1791355 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:36.795649 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3920da52-0dc1-40d7-a2a5-5a19b1791355 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1461 microversion: 2.1 time: 0.212084 Jun 07 13:20:36.796346 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 187/386] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:36 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1461 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:37.546818 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d03a3512-d528-4996-81e7-68e9e0092713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:37.547709 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d03a3512-d528-4996-81e7-68e9e0092713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:37.554095 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d03a3512-d528-4996-81e7-68e9e0092713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:37.554543 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d03a3512-d528-4996-81e7-68e9e0092713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.555343 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d03a3512-d528-4996-81e7-68e9e0092713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:37.555780 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d03a3512-d528-4996-81e7-68e9e0092713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.574591 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-58b32908-69d0-483f-b6b1-45812fd622a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:37.575228 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-58b32908-69d0-483f-b6b1-45812fd622a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:37.581562 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58b32908-69d0-483f-b6b1-45812fd622a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:37.582014 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58b32908-69d0-483f-b6b1-45812fd622a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.582776 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58b32908-69d0-483f-b6b1-45812fd622a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:37.583239 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58b32908-69d0-483f-b6b1-45812fd622a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.765815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d03a3512-d528-4996-81e7-68e9e0092713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:37.775307 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-58b32908-69d0-483f-b6b1-45812fd622a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:37.776242 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d03a3512-d528-4996-81e7-68e9e0092713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1367 microversion: 2.1 time: 0.233500 Jun 07 13:20:37.777252 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 200/387] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:37 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:37.786138 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-58b32908-69d0-483f-b6b1-45812fd622a5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.215269 Jun 07 13:20:37.786782 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 188/388] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:37 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:37.814176 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:37.817658 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:37.832161 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:37.832766 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.833723 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:37.834174 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.871730 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:37.872290 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.872807 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lazy-loading 'fault' on Instance uuid dadfca8e-afc3-4687-ba6e-a714b6137139 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:20:37.920620 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d5d87476eb4c8d8ceacf022fe4135d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aac41f4f074858ba560987a158c38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:37.929420 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ab8b93c0-b94a-4df6-941c-5b87462ccb39 tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 200 len: 1303 microversion: 2.1 time: 0.119863 Jun 07 13:20:37.930007 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 201/389] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:37 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:38.794431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-13244916-aa52-42b7-93c0-264787f55810 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:38.795120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-13244916-aa52-42b7-93c0-264787f55810 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:38.801598 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-13244916-aa52-42b7-93c0-264787f55810 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:38.802051 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-13244916-aa52-42b7-93c0-264787f55810 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:38.802813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-13244916-aa52-42b7-93c0-264787f55810 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:38.803409 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-13244916-aa52-42b7-93c0-264787f55810 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:38.804051 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b50223e2-ecbb-4448-95c2-d7456601c960 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:38.804667 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b50223e2-ecbb-4448-95c2-d7456601c960 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:38.806607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:38.811910 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b50223e2-ecbb-4448-95c2-d7456601c960 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:38.812362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b50223e2-ecbb-4448-95c2-d7456601c960 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:38.813126 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b50223e2-ecbb-4448-95c2-d7456601c960 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:38.813557 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b50223e2-ecbb-4448-95c2-d7456601c960 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:39.005000 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-13244916-aa52-42b7-93c0-264787f55810 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:39.008154 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b50223e2-ecbb-4448-95c2-d7456601c960 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:39.013114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-13244916-aa52-42b7-93c0-264787f55810 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1558 microversion: 2.1 time: 0.223298 Jun 07 13:20:39.013689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 189/390] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:38 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:39.016506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b50223e2-ecbb-4448-95c2-d7456601c960 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.216483 Jun 07 13:20:39.017312 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 202/391] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:38 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:39.018285 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:39.018919 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] [instance: dadfca8e-afc3-4687-ba6e-a714b6137139] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:39.024765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:39.025214 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:39.026923 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:39.027364 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:39.032015 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:39.032201 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d3031b0e-8ba3-4498-a41c-8ffe0bc691db tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:39.032201 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d3031b0e-8ba3-4498-a41c-8ffe0bc691db tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:39.036861 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d3031b0e-8ba3-4498-a41c-8ffe0bc691db tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:39.037314 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d3031b0e-8ba3-4498-a41c-8ffe0bc691db tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:39.038090 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d3031b0e-8ba3-4498-a41c-8ffe0bc691db tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:39.038523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d3031b0e-8ba3-4498-a41c-8ffe0bc691db tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:39.043452 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] HTTP exception thrown: Instance dadfca8e-afc3-4687-ba6e-a714b6137139 could not be found. Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Request method failure captured: Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 HTTP/1.1 Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1BdBToYwgbXPlpROZfzeXgie99GimX_3Tc3pKS3xpBBskJnEeuHcUZwyD6fBlPKTwFDpJJ6AXR9wWqdAzibpTxGyWOvedMVnykBt_wNIoyZf-EjwGfWLAgzHpMo9nRzvXVeN8jU2XbwfN31fdh99H4L0uSfBHEQpnv868jIOj_pCHw Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: d1aac41f4f074858ba560987a158c38b Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-VolumesActionsTest-2110775270 Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:20:39.045096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d1aac41f4f074858ba560987a158c38b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d1aac41f4f074858ba560987a158c38b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d1aac41f4f074858ba560987a158c38b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d1aac41f4f074858ba560987a158c38b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-VolumesActionsTest-2110775270 Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: d1aac41f4f074858ba560987a158c38b Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-VolumesActionsTest-2110775270 Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-VolumesActionsTest-2110775270-project Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 51d5d87476eb4c8d8ceacf022fe4135d Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-VolumesActionsTest-2110775270-project Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance dadfca8e-afc3-4687-ba6e-a714b6137139 could not be found. Jun 07 13:20:39.046645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': 'dadfca8e-afc3-4687-ba6e-a714b6137139'} Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dadfca8e-afc3-4687-ba6e-a714b6137139 could not be found. Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:20:39.047501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dadfca8e-afc3-4687-ba6e-a714b6137139 could not be found. Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dadfca8e-afc3-4687-ba6e-a714b6137139 could not be found. Jun 07 13:20:39.048940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:20:39.050052 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] Returning 404 to user: Instance dadfca8e-afc3-4687-ba6e-a714b6137139 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:20:39.050052 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-088dba26-7c40-419b-87df-0b30f7139aaa tempest-VolumesActionsTest-2110775270 tempest-VolumesActionsTest-2110775270-project] 10.222.0.61 "GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139" status: 404 len: 111 microversion: 2.1 time: 0.031890 Jun 07 13:20:39.050052 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 190/392] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:39 2022] GET /compute/v2.1/servers/dadfca8e-afc3-4687-ba6e-a714b6137139 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:20:39.120207 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d3031b0e-8ba3-4498-a41c-8ffe0bc691db tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094871 Jun 07 13:20:39.120807 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 203/393] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Jun 7 13:20:39 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:40.033479 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1676e469-5e9b-4373-8ec9-9b0afb64e95e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:40.034190 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1676e469-5e9b-4373-8ec9-9b0afb64e95e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:40.041627 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1676e469-5e9b-4373-8ec9-9b0afb64e95e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:40.042085 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1676e469-5e9b-4373-8ec9-9b0afb64e95e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:40.042862 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1676e469-5e9b-4373-8ec9-9b0afb64e95e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:40.043303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1676e469-5e9b-4373-8ec9-9b0afb64e95e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:40.088209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-2f36cba9-265b-4605-ba63-e64d4d895089 req-53cd4018-ea36-409c-81a9-5c6b8c4d05d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20833de2-a8ed-47e0-a402-7d2c367a5fe5", "tag": "e03bee43-ba5c-48ca-bb29-489689c6a119"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:40.096728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-2f36cba9-265b-4605-ba63-e64d4d895089 req-53cd4018-ea36-409c-81a9-5c6b8c4d05d9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:40.097441 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-2f36cba9-265b-4605-ba63-e64d4d895089 req-53cd4018-ea36-409c-81a9-5c6b8c4d05d9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:40.109167 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-2f36cba9-265b-4605-ba63-e64d4d895089 req-53cd4018-ea36-409c-81a9-5c6b8c4d05d9 service nova] Creating event network-changed:e03bee43-ba5c-48ca-bb29-489689c6a119 for instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 on hv-cinder-84460 Jun 07 13:20:40.114014 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-2f36cba9-265b-4605-ba63-e64d4d895089 req-53cd4018-ea36-409c-81a9-5c6b8c4d05d9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029572 Jun 07 13:20:40.114782 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 204/394] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:40.189863 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1676e469-5e9b-4373-8ec9-9b0afb64e95e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:40.199288 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1676e469-5e9b-4373-8ec9-9b0afb64e95e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.169411 Jun 07 13:20:40.200005 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 191/395] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:40 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:41.216976 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b5d9895f-7c37-4516-bf05-630e93c31022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:41.218320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b5d9895f-7c37-4516-bf05-630e93c31022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:41.225555 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5d9895f-7c37-4516-bf05-630e93c31022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:41.225746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5d9895f-7c37-4516-bf05-630e93c31022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:41.226722 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5d9895f-7c37-4516-bf05-630e93c31022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:41.227281 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b5d9895f-7c37-4516-bf05-630e93c31022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:41.361720 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b5d9895f-7c37-4516-bf05-630e93c31022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:41.369208 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b5d9895f-7c37-4516-bf05-630e93c31022 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.157134 Jun 07 13:20:41.370478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 205/396] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:41 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:42.195470 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-395c01e4-b410-4517-aa2c-adf846a960a6 req-952c56c6-472a-4d8a-852e-94a83ef24455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb5d9cf-92eb-45b1-b8b5-73af66067558", "name": "network-vif-plugged", "status": "completed", "tag": "541e0200-55c0-4b40-a06e-d6fcf5d21cf5"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:42.210091 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-395c01e4-b410-4517-aa2c-adf846a960a6 req-952c56c6-472a-4d8a-852e-94a83ef24455 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:42.210544 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-395c01e4-b410-4517-aa2c-adf846a960a6 req-952c56c6-472a-4d8a-852e-94a83ef24455 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:42.226521 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-395c01e4-b410-4517-aa2c-adf846a960a6 req-952c56c6-472a-4d8a-852e-94a83ef24455 service nova] Creating event network-vif-plugged:541e0200-55c0-4b40-a06e-d6fcf5d21cf5 for instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 on hv-cinder-84460 Jun 07 13:20:42.232548 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-395c01e4-b410-4517-aa2c-adf846a960a6 req-952c56c6-472a-4d8a-852e-94a83ef24455 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040704 Jun 07 13:20:42.234253 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 192/397] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:42.387307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0e4e640f-ef37-4099-9731-d7ff516d85df tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:42.387928 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0e4e640f-ef37-4099-9731-d7ff516d85df tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:42.394274 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0e4e640f-ef37-4099-9731-d7ff516d85df tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:42.394734 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0e4e640f-ef37-4099-9731-d7ff516d85df tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:42.395544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0e4e640f-ef37-4099-9731-d7ff516d85df tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:42.395987 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0e4e640f-ef37-4099-9731-d7ff516d85df tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:42.524295 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0e4e640f-ef37-4099-9731-d7ff516d85df tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:42.531821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0e4e640f-ef37-4099-9731-d7ff516d85df tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.149327 Jun 07 13:20:42.532394 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 206/398] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:42 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:43.549928 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b41344a6-bce2-4be7-bebf-32fea377ecee tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:43.550615 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b41344a6-bce2-4be7-bebf-32fea377ecee tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:43.562123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b41344a6-bce2-4be7-bebf-32fea377ecee tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:43.562579 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b41344a6-bce2-4be7-bebf-32fea377ecee tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:43.563389 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b41344a6-bce2-4be7-bebf-32fea377ecee tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:43.563819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b41344a6-bce2-4be7-bebf-32fea377ecee tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:43.692311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b41344a6-bce2-4be7-bebf-32fea377ecee tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:43.700970 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b41344a6-bce2-4be7-bebf-32fea377ecee tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.155732 Jun 07 13:20:43.701555 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 193/399] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:43 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:44.718222 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-847fa044-741a-4534-88bb-e4ab81873ca8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:44.718964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-847fa044-741a-4534-88bb-e4ab81873ca8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:44.721063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=4 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:44.726815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-847fa044-741a-4534-88bb-e4ab81873ca8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:44.727290 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-847fa044-741a-4534-88bb-e4ab81873ca8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:44.728055 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-847fa044-741a-4534-88bb-e4ab81873ca8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:44.728487 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-847fa044-741a-4534-88bb-e4ab81873ca8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:44.859365 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-847fa044-741a-4534-88bb-e4ab81873ca8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:44.866674 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-847fa044-741a-4534-88bb-e4ab81873ca8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.152290 Jun 07 13:20:44.867270 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 207/400] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:44 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:45.883535 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-45183407-0bfd-48a0-8180-183723318ddc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:45.884146 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-45183407-0bfd-48a0-8180-183723318ddc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:45.887255 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:45.892336 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-45183407-0bfd-48a0-8180-183723318ddc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:45.892793 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-45183407-0bfd-48a0-8180-183723318ddc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:45.893559 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-45183407-0bfd-48a0-8180-183723318ddc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:45.893991 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-45183407-0bfd-48a0-8180-183723318ddc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:46.024988 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-45183407-0bfd-48a0-8180-183723318ddc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:46.032840 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-45183407-0bfd-48a0-8180-183723318ddc tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.153183 Jun 07 13:20:46.033407 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 194/401] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:45 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:47.049980 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-72887872-6add-4ea5-89d0-c88ccebb1387 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:47.050599 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-72887872-6add-4ea5-89d0-c88ccebb1387 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:47.056954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72887872-6add-4ea5-89d0-c88ccebb1387 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:47.057405 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72887872-6add-4ea5-89d0-c88ccebb1387 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:47.058205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72887872-6add-4ea5-89d0-c88ccebb1387 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:47.058714 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72887872-6add-4ea5-89d0-c88ccebb1387 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:47.215731 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-72887872-6add-4ea5-89d0-c88ccebb1387 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:47.225518 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-72887872-6add-4ea5-89d0-c88ccebb1387 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1371 microversion: 2.1 time: 0.179062 Jun 07 13:20:47.226121 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 208/402] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:47 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:48.243703 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e6325536-8032-424b-bb35-0af6bb3dc6f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:48.244489 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e6325536-8032-424b-bb35-0af6bb3dc6f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:48.252613 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e6325536-8032-424b-bb35-0af6bb3dc6f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:48.253156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e6325536-8032-424b-bb35-0af6bb3dc6f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:48.254009 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e6325536-8032-424b-bb35-0af6bb3dc6f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:48.254552 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e6325536-8032-424b-bb35-0af6bb3dc6f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:48.425207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e6325536-8032-424b-bb35-0af6bb3dc6f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:48.444532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e6325536-8032-424b-bb35-0af6bb3dc6f5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1564 microversion: 2.1 time: 0.204422 Jun 07 13:20:48.456152 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 195/403] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:48 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1564 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:48.471886 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-efeedf1b-ad14-414a-b08a-63a0021d2d3f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:48.473473 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-efeedf1b-ad14-414a-b08a-63a0021d2d3f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:48.483862 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-efeedf1b-ad14-414a-b08a-63a0021d2d3f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:48.484312 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-efeedf1b-ad14-414a-b08a-63a0021d2d3f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:48.485084 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-efeedf1b-ad14-414a-b08a-63a0021d2d3f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:48.485517 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-efeedf1b-ad14-414a-b08a-63a0021d2d3f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:48.570956 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-efeedf1b-ad14-414a-b08a-63a0021d2d3f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111047 Jun 07 13:20:48.577765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 209/404] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Jun 7 13:20:48 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:50.116342 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-c2e54a3e-f508-458f-ae63-96e049754650 req-f47c42f0-421c-45cb-8b83-5bfbb00215ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb5d9cf-92eb-45b1-b8b5-73af66067558", "tag": "541e0200-55c0-4b40-a06e-d6fcf5d21cf5"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:50.127239 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-c2e54a3e-f508-458f-ae63-96e049754650 req-f47c42f0-421c-45cb-8b83-5bfbb00215ce service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:50.128032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-c2e54a3e-f508-458f-ae63-96e049754650 req-f47c42f0-421c-45cb-8b83-5bfbb00215ce service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:50.144541 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-c2e54a3e-f508-458f-ae63-96e049754650 req-f47c42f0-421c-45cb-8b83-5bfbb00215ce service nova] Creating event network-changed:541e0200-55c0-4b40-a06e-d6fcf5d21cf5 for instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 on hv-cinder-84460 Jun 07 13:20:50.152293 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-c2e54a3e-f508-458f-ae63-96e049754650 req-f47c42f0-421c-45cb-8b83-5bfbb00215ce service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039860 Jun 07 13:20:50.154136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 196/405] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:57.383529 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-387401216", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1670039504", "security_groups": [{"name": "tempest-secgroup-smoke-2066727904"}], "block_device_mapping_v2": [{"uuid": "f7243ad9-969d-42e9-a826-7bfde4d0ca73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f22df14-4055-4a5c-b07f-b9c47fcaaaf4"}]}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:57.727080 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] validate_networks() for [('9f22df14-4055-4a5c-b07f-b9c47fcaaaf4', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:20:58.376130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:20:58.376555 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:20:58.377034 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:20:58.377447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:20:58.377863 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:20:58.391224 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:58.391938 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:58.392688 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:58.393350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:58.415447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Getting quotas for project b562a09561af4197bf2835b31a9dd34e. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:58.435848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Getting quotas for user 36c5458a18f146be87207e0f6dd598eb and project b562a09561af4197bf2835b31a9dd34e. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:58.505953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:20:58.508214 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7243ad9-969d-42e9-a826-7bfde4d0ca73',volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:20:58.680667 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-62567f8c-81dc-4fd0-abae-c351f98ee197 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.303110 Jun 07 13:20:58.681338 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 210/406] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:20:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:20:58.693384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-265d1bd5-d636-40d8-a534-a6a25864ec8a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:58.694088 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-265d1bd5-d636-40d8-a534-a6a25864ec8a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:58.795204 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-265d1bd5-d636-40d8-a534-a6a25864ec8a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:58.820188 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-265d1bd5-d636-40d8-a534-a6a25864ec8a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1094 microversion: 2.1 time: 0.131802 Jun 07 13:20:58.823481 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 197/407] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:58 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:59.840738 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3841c5cd-50c2-4d4d-b5cf-002aee19d754 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:59.841361 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3841c5cd-50c2-4d4d-b5cf-002aee19d754 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:59.848692 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3841c5cd-50c2-4d4d-b5cf-002aee19d754 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:59.849525 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3841c5cd-50c2-4d4d-b5cf-002aee19d754 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:59.850900 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3841c5cd-50c2-4d4d-b5cf-002aee19d754 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:59.851565 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3841c5cd-50c2-4d4d-b5cf-002aee19d754 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:59.919815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3841c5cd-50c2-4d4d-b5cf-002aee19d754 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:59.927711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3841c5cd-50c2-4d4d-b5cf-002aee19d754 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1192 microversion: 2.1 time: 0.091406 Jun 07 13:20:59.928404 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 211/408] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:59 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:00.952694 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-59de5ef0-6bd1-4746-aa2c-2f40d1b2f487 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:00.954407 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-59de5ef0-6bd1-4746-aa2c-2f40d1b2f487 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:00.961182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=29 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:00.995121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-59de5ef0-6bd1-4746-aa2c-2f40d1b2f487 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:00.997868 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-59de5ef0-6bd1-4746-aa2c-2f40d1b2f487 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:00.998931 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-59de5ef0-6bd1-4746-aa2c-2f40d1b2f487 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:01.001572 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-59de5ef0-6bd1-4746-aa2c-2f40d1b2f487 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:01.268378 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-59de5ef0-6bd1-4746-aa2c-2f40d1b2f487 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:01.282262 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-59de5ef0-6bd1-4746-aa2c-2f40d1b2f487 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1278 microversion: 2.1 time: 0.338455 Jun 07 13:21:01.293510 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 198/409] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:00 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1278 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:01.982808 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-7be95a60-306d-4bdb-bea3-72cc438ca300 req-2e5ea481-db16-47b9-a503-9444b67d97d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2015ad36-8c9d-42a6-b493-ebed58fb80bd", "tag": "110b12e8-380e-45f8-9b34-02595fa36a2c"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:02.021845 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-7be95a60-306d-4bdb-bea3-72cc438ca300 req-2e5ea481-db16-47b9-a503-9444b67d97d3 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:02.022699 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-7be95a60-306d-4bdb-bea3-72cc438ca300 req-2e5ea481-db16-47b9-a503-9444b67d97d3 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:02.038856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-7be95a60-306d-4bdb-bea3-72cc438ca300 req-2e5ea481-db16-47b9-a503-9444b67d97d3 service nova] Creating event network-changed:110b12e8-380e-45f8-9b34-02595fa36a2c for instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd on hv-cinder-84460 Jun 07 13:21:02.051149 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-7be95a60-306d-4bdb-bea3-72cc438ca300 req-2e5ea481-db16-47b9-a503-9444b67d97d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073421 Jun 07 13:21:02.052478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 212/410] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:02.300955 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-429aa2fd-ead2-4c1e-803f-999d248c8895 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:02.301791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-429aa2fd-ead2-4c1e-803f-999d248c8895 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:02.312708 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-429aa2fd-ead2-4c1e-803f-999d248c8895 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:02.313954 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-429aa2fd-ead2-4c1e-803f-999d248c8895 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:02.315707 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-429aa2fd-ead2-4c1e-803f-999d248c8895 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:02.316312 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-429aa2fd-ead2-4c1e-803f-999d248c8895 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:02.503863 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-429aa2fd-ead2-4c1e-803f-999d248c8895 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:02.512676 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-429aa2fd-ead2-4c1e-803f-999d248c8895 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.215408 Jun 07 13:21:02.513408 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 199/411] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:02 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:02.522326 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f7184148-1ff1-4f54-9204-ffbbdc8e30ad tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:02.523255 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f7184148-1ff1-4f54-9204-ffbbdc8e30ad tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:02.534417 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f7184148-1ff1-4f54-9204-ffbbdc8e30ad tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:02.535269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f7184148-1ff1-4f54-9204-ffbbdc8e30ad tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:02.536950 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f7184148-1ff1-4f54-9204-ffbbdc8e30ad tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:02.537879 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f7184148-1ff1-4f54-9204-ffbbdc8e30ad tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:02.578236 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f7184148-1ff1-4f54-9204-ffbbdc8e30ad tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/ips" status: 200 len: 152 microversion: 2.20 time: 0.061693 Jun 07 13:21:02.579438 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 213/412] 10.222.0.61 () {60 vars in 1288 bytes} [Tue Jun 7 13:21:02 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/ips => generated 152 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:21:03.532210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a5920f00-2a3f-40e9-9086-738eecd0538a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:03.534236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a5920f00-2a3f-40e9-9086-738eecd0538a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:03.550916 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a5920f00-2a3f-40e9-9086-738eecd0538a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:03.551321 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a5920f00-2a3f-40e9-9086-738eecd0538a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:03.552526 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a5920f00-2a3f-40e9-9086-738eecd0538a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:03.553204 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a5920f00-2a3f-40e9-9086-738eecd0538a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:03.724926 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a5920f00-2a3f-40e9-9086-738eecd0538a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:03.733356 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a5920f00-2a3f-40e9-9086-738eecd0538a tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.207436 Jun 07 13:21:03.734665 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 200/413] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:03 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:04.755610 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6e4bd856-5cd7-41c6-9812-7a80b83098a8 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:04.756234 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6e4bd856-5cd7-41c6-9812-7a80b83098a8 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:04.762518 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e4bd856-5cd7-41c6-9812-7a80b83098a8 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:04.763256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e4bd856-5cd7-41c6-9812-7a80b83098a8 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:04.764520 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e4bd856-5cd7-41c6-9812-7a80b83098a8 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:04.765130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e4bd856-5cd7-41c6-9812-7a80b83098a8 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:04.914244 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6e4bd856-5cd7-41c6-9812-7a80b83098a8 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:04.925112 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6e4bd856-5cd7-41c6-9812-7a80b83098a8 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.173986 Jun 07 13:21:04.925810 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 214/414] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:04 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:05.942274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f81e72e9-1eaf-463f-9936-0842f27e0102 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:05.943096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f81e72e9-1eaf-463f-9936-0842f27e0102 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:05.950035 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f81e72e9-1eaf-463f-9936-0842f27e0102 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:05.951059 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f81e72e9-1eaf-463f-9936-0842f27e0102 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:05.952066 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f81e72e9-1eaf-463f-9936-0842f27e0102 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:05.952714 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f81e72e9-1eaf-463f-9936-0842f27e0102 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.119559 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f81e72e9-1eaf-463f-9936-0842f27e0102 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:06.127977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f81e72e9-1eaf-463f-9936-0842f27e0102 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.189914 Jun 07 13:21:06.129065 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 201/415] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:05 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:06.275383 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ffc13194-def5-43a0-8ba0-eb73ced020d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:06.276510 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ffc13194-def5-43a0-8ba0-eb73ced020d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:06.284494 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ffc13194-def5-43a0-8ba0-eb73ced020d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:06.285014 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ffc13194-def5-43a0-8ba0-eb73ced020d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.286301 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ffc13194-def5-43a0-8ba0-eb73ced020d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:06.286747 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ffc13194-def5-43a0-8ba0-eb73ced020d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.289569 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=89 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:06.313508 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-ffc13194-def5-43a0-8ba0-eb73ced020d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lazy-loading 'flavor' on Instance uuid 9a2d4bcb-ea81-4550-be2e-2689fffd0943 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:21:06.590233 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ffc13194-def5-43a0-8ba0-eb73ced020d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/action" status: 202 len: 0 microversion: 2.20 time: 0.318338 Jun 07 13:21:06.593991 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 215/416] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Jun 7 13:21:06 2022] POST /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:21:06.599924 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:06.601982 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:06.613761 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:06.614220 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.615062 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:06.615721 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.755722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:06.764583 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:06.766229 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:06.767420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-612a2cba-5c2f-4e02-a9c7-fc68dc4deceb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.171771 Jun 07 13:21:06.767972 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 202/417] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:06 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:07.146089 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-341eb48f-3f9c-42a6-b5fb-85a0d0153b36 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:07.146964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-341eb48f-3f9c-42a6-b5fb-85a0d0153b36 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:07.153720 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-341eb48f-3f9c-42a6-b5fb-85a0d0153b36 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.154298 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-341eb48f-3f9c-42a6-b5fb-85a0d0153b36 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.155140 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-341eb48f-3f9c-42a6-b5fb-85a0d0153b36 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.155636 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-341eb48f-3f9c-42a6-b5fb-85a0d0153b36 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.303066 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-341eb48f-3f9c-42a6-b5fb-85a0d0153b36 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:07.313349 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-341eb48f-3f9c-42a6-b5fb-85a0d0153b36 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.171513 Jun 07 13:21:07.314848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 216/418] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:07 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:07.786447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:07.787373 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:07.796607 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.797068 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.797960 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.798511 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.953788 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:07.963280 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:07.964808 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:07.966074 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a19f402b-9b8f-4d39-9a08-f670333c8765 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.183872 Jun 07 13:21:07.966711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 203/419] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:07 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:08.330548 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-70698e13-bb46-4cb1-ba36-6c7c973dac5c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:08.332140 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-70698e13-bb46-4cb1-ba36-6c7c973dac5c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:08.339443 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70698e13-bb46-4cb1-ba36-6c7c973dac5c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:08.340552 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70698e13-bb46-4cb1-ba36-6c7c973dac5c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:08.341450 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70698e13-bb46-4cb1-ba36-6c7c973dac5c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:08.342145 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70698e13-bb46-4cb1-ba36-6c7c973dac5c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:08.404305 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:08.444704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=6 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:08.538685 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-70698e13-bb46-4cb1-ba36-6c7c973dac5c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:08.546355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-70698e13-bb46-4cb1-ba36-6c7c973dac5c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.219739 Jun 07 13:21:08.553354 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 217/420] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:08 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:08.984193 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:08.984808 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:08.987165 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:08.992904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:08.993357 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:08.994125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:08.994561 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.123615 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:09.131472 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:09.132980 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:09.134753 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a7e30021-d3ff-475f-97cd-30f522366f3f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.154313 Jun 07 13:21:09.135048 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 204/421] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:08 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:09.563998 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-523deec8-3246-4231-8d84-471c79d4cc8e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:09.564548 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-523deec8-3246-4231-8d84-471c79d4cc8e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:09.566405 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:09.571746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-523deec8-3246-4231-8d84-471c79d4cc8e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:09.572204 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-523deec8-3246-4231-8d84-471c79d4cc8e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.572973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-523deec8-3246-4231-8d84-471c79d4cc8e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:09.573415 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-523deec8-3246-4231-8d84-471c79d4cc8e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.700138 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-523deec8-3246-4231-8d84-471c79d4cc8e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:09.707814 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-523deec8-3246-4231-8d84-471c79d4cc8e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.147724 Jun 07 13:21:09.708374 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 218/422] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:09 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:10.153277 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:10.153799 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:10.160556 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:10.161003 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:10.161754 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:10.162185 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:10.288129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:10.296699 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:10.298250 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:10.299446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ae78c235-06db-4c34-8ed4-d51128cf9ea4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.150768 Jun 07 13:21:10.300008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 205/423] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:10 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:21:10.560711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-eb514963-f49e-4d53-ae54-8fcd4623afaf req-02278aac-0571-4c02-9449-4d829e6af8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2015ad36-8c9d-42a6-b493-ebed58fb80bd", "name": "network-vif-plugged", "status": "completed", "tag": "110b12e8-380e-45f8-9b34-02595fa36a2c"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:10.570750 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-eb514963-f49e-4d53-ae54-8fcd4623afaf req-02278aac-0571-4c02-9449-4d829e6af8c9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:10.571365 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-eb514963-f49e-4d53-ae54-8fcd4623afaf req-02278aac-0571-4c02-9449-4d829e6af8c9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:10.583643 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-eb514963-f49e-4d53-ae54-8fcd4623afaf req-02278aac-0571-4c02-9449-4d829e6af8c9 service nova] Creating event network-vif-plugged:110b12e8-380e-45f8-9b34-02595fa36a2c for instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd on hv-cinder-84460 Jun 07 13:21:10.588809 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-eb514963-f49e-4d53-ae54-8fcd4623afaf req-02278aac-0571-4c02-9449-4d829e6af8c9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032880 Jun 07 13:21:10.589530 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 219/424] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:21:10.724647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2b370ec9-aa8d-4b48-8094-134ef1740530 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:10.725262 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2b370ec9-aa8d-4b48-8094-134ef1740530 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:10.732392 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2b370ec9-aa8d-4b48-8094-134ef1740530 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:10.732933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2b370ec9-aa8d-4b48-8094-134ef1740530 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:10.733772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2b370ec9-aa8d-4b48-8094-134ef1740530 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:10.734278 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2b370ec9-aa8d-4b48-8094-134ef1740530 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:10.882453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2b370ec9-aa8d-4b48-8094-134ef1740530 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:10.891419 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2b370ec9-aa8d-4b48-8094-134ef1740530 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.170608 Jun 07 13:21:10.891984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 206/425] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:10 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:11.317575 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:11.318327 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:11.324466 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:11.324914 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:11.325769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:11.326245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:11.461716 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:11.469610 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:11.471174 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:11.472373 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3584f3db-56f4-404b-8b98-42f0c15a1ae4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.159124 Jun 07 13:21:11.472935 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 220/426] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:11 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:11.908886 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9835cdb9-523c-4e5e-a9e7-9459e3bb8b05 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:11.909494 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9835cdb9-523c-4e5e-a9e7-9459e3bb8b05 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:11.915966 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9835cdb9-523c-4e5e-a9e7-9459e3bb8b05 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:11.916413 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9835cdb9-523c-4e5e-a9e7-9459e3bb8b05 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:11.917160 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9835cdb9-523c-4e5e-a9e7-9459e3bb8b05 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:11.917588 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9835cdb9-523c-4e5e-a9e7-9459e3bb8b05 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:12.045165 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9835cdb9-523c-4e5e-a9e7-9459e3bb8b05 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:12.052605 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9835cdb9-523c-4e5e-a9e7-9459e3bb8b05 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.147616 Jun 07 13:21:12.053167 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 207/427] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:11 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:12.490303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:12.490945 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:12.497678 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:12.498138 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:12.498944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:12.499367 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:12.660678 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:12.672084 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:12.674002 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:12.675503 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fe6e2ac3-31cc-4ceb-b63b-19fc5b395b7e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.189115 Jun 07 13:21:12.676218 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 221/428] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:12 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:13.069601 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1a243fc7-49c3-4ae6-a7a3-97e538a4b098 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:13.070453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1a243fc7-49c3-4ae6-a7a3-97e538a4b098 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:13.077459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1a243fc7-49c3-4ae6-a7a3-97e538a4b098 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.077902 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1a243fc7-49c3-4ae6-a7a3-97e538a4b098 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.078658 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1a243fc7-49c3-4ae6-a7a3-97e538a4b098 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.079115 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1a243fc7-49c3-4ae6-a7a3-97e538a4b098 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.215038 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1a243fc7-49c3-4ae6-a7a3-97e538a4b098 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:13.223150 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1a243fc7-49c3-4ae6-a7a3-97e538a4b098 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1266 microversion: 2.1 time: 0.157386 Jun 07 13:21:13.223727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 208/429] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:13 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:13.696694 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:13.697417 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:13.703413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.703939 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.704887 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.705331 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.849252 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:13.858070 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:13.859643 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:13.860829 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-82c247f0-1a11-4da1-aa47-634bb1ac429d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.167941 Jun 07 13:21:13.861388 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 222/430] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:13 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:14.240758 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2926bfca-c1d9-4891-93cf-0de652f12de1 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:14.241377 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2926bfca-c1d9-4891-93cf-0de652f12de1 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:14.248514 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2926bfca-c1d9-4891-93cf-0de652f12de1 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:14.248968 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2926bfca-c1d9-4891-93cf-0de652f12de1 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:14.249727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2926bfca-c1d9-4891-93cf-0de652f12de1 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:14.250165 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2926bfca-c1d9-4891-93cf-0de652f12de1 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:14.379654 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2926bfca-c1d9-4891-93cf-0de652f12de1 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:14.387184 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2926bfca-c1d9-4891-93cf-0de652f12de1 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1452 microversion: 2.1 time: 0.150259 Jun 07 13:21:14.387778 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 209/431] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:14 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:14.403602 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2fc37be5-4be4-4661-9d43-77b97a532250 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:14.404224 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2fc37be5-4be4-4661-9d43-77b97a532250 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:14.410097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2fc37be5-4be4-4661-9d43-77b97a532250 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:14.410560 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2fc37be5-4be4-4661-9d43-77b97a532250 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:14.411379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2fc37be5-4be4-4661-9d43-77b97a532250 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:14.411815 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2fc37be5-4be4-4661-9d43-77b97a532250 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:14.539223 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2fc37be5-4be4-4661-9d43-77b97a532250 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:14.547214 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2fc37be5-4be4-4661-9d43-77b97a532250 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1452 microversion: 2.1 time: 0.147343 Jun 07 13:21:14.547780 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 223/432] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:14 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:14.878451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:14.879135 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:14.885166 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:14.885621 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:14.886382 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:14.886816 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:15.026514 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:15.035126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:15.036640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:15.037986 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ea58c787-ca52-4f46-9949-dfeabf78e20d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.163469 Jun 07 13:21:15.038557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 210/433] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:14 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:21:16.056238 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:16.056837 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:16.063462 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:16.063919 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:16.064686 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:16.065126 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:16.200052 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:16.209147 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:16.210786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:16.212079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ce6eb11c-c1be-4c81-9e25-a2ba9710461f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.159888 Jun 07 13:21:16.212644 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 224/434] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:16 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:21:16.529764 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-a94c4339-54b1-438a-b9f6-55de1bbe339d req-9097a0f4-58a4-4f10-832b-737a7894d7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2015ad36-8c9d-42a6-b493-ebed58fb80bd", "tag": "110b12e8-380e-45f8-9b34-02595fa36a2c"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:16.535579 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=36 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:16.539557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-a94c4339-54b1-438a-b9f6-55de1bbe339d req-9097a0f4-58a4-4f10-832b-737a7894d7ee service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:16.540007 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-a94c4339-54b1-438a-b9f6-55de1bbe339d req-9097a0f4-58a4-4f10-832b-737a7894d7ee service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:16.553141 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-a94c4339-54b1-438a-b9f6-55de1bbe339d req-9097a0f4-58a4-4f10-832b-737a7894d7ee service nova] Creating event network-changed:110b12e8-380e-45f8-9b34-02595fa36a2c for instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd on hv-cinder-84460 Jun 07 13:21:16.558549 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-a94c4339-54b1-438a-b9f6-55de1bbe339d req-9097a0f4-58a4-4f10-832b-737a7894d7ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032374 Jun 07 13:21:16.559519 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 211/435] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:21:17.229768 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:17.230571 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:17.236866 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:17.237409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:17.238241 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:17.238931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:17.381792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:17.390677 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:17.392306 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:17.393601 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c2baec5f-7c49-4e78-a859-3b5f0e3370b5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.167985 Jun 07 13:21:17.394236 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 225/436] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:17 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:18.413381 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:18.414066 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:18.420876 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:18.421324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:18.422078 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:18.422506 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:18.551359 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:18.559590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:18.561083 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:18.562236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c4cec3bc-4e96-4879-b106-01e5a3ae8a89 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.153607 Jun 07 13:21:18.562785 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 212/437] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:18 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:19.580601 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:19.581208 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:19.587748 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:19.588200 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:19.588958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:19.589387 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:19.713291 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:19.721028 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:19.722530 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:19.723710 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-02574a9a-2444-4a08-8b55-41629fa3992e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.147007 Jun 07 13:21:19.724262 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 226/438] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:19 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:20.742286 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:20.742922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:20.750047 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:20.750496 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:20.751283 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:20.751719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:20.880659 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:20.889219 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:20.890722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:20.891914 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9799fed6-e94b-4cb4-bd4a-b780684b802f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.153506 Jun 07 13:21:20.892473 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 213/439] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:20 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:21.916713 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:21.917320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:21.923437 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:21.923885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:21.924636 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:21.925067 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:22.052635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:22.060876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:22.062369 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:22.063554 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5f164728-e7a3-4b21-82d2-c2fc3eb53d90 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.150707 Jun 07 13:21:22.064107 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 227/440] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:21 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:23.081462 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:23.082103 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:23.088664 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:23.089117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:23.089880 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:23.090318 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:23.213380 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:23.221855 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:23.223418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:23.224586 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d17469b0-cf97-44d6-9b00-686d6f913df4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.147034 Jun 07 13:21:23.225145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 214/441] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:23 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:24.243097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:24.243878 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:24.250422 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:24.250893 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:24.251655 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:24.252118 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:24.383146 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:24.392511 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:24.394076 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:24.395289 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c99a8d9e-7732-4bf5-b095-1bdda6790268 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.156249 Jun 07 13:21:24.395844 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 228/442] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:24 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:25.413390 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:25.414005 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:25.420663 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:25.421114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:25.421911 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:25.422345 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:25.427665 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=100 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:25.549508 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:25.557398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:25.558927 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:25.560088 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ac40e04f-1f6c-436c-96bd-8743193eb86e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.150818 Jun 07 13:21:25.560648 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 215/443] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:25 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:26.578127 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:26.578805 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:26.584795 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:26.585245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:26.586000 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:26.586437 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:26.713268 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:26.721104 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:26.722604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:26.723779 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f4757440-2bea-4447-927c-314051f9c209 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.150218 Jun 07 13:21:26.724332 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 229/444] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:26 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:27.740963 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:27.741576 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:27.748034 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:27.748482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:27.749240 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:27.749671 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:27.876270 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:27.884143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:27.885639 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:27.886797 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-03f23b46-7424-446d-b2f4-1506aa1df7ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1744 microversion: 2.20 time: 0.149733 Jun 07 13:21:27.887386 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 216/445] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:27 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:28.905590 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:28.906132 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:28.912287 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:28.912748 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:28.913515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:28.913952 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:28.929356 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:29.045604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:29.053367 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:29.054884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:29.056038 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-66cf0dfb-b88f-4614-ab68-f098c99bb020 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1744 microversion: 2.20 time: 0.154906 Jun 07 13:21:29.056578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 230/446] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:28 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:30.073925 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:30.074447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:30.080998 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:30.081443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:30.082195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:30.082621 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:30.212416 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:30.220715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:30.222218 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:30.223415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3bb37653-737e-4c30-9c98-20f9b3950824 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1744 microversion: 2.20 time: 0.153443 Jun 07 13:21:30.223973 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 217/447] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:30 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:31.241758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:31.242380 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:31.252949 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:31.253741 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:31.254867 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:31.255414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:31.408053 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:31.425184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:31.426698 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:31.427897 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7d83039a-300c-485b-b702-783217993eef tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1739 microversion: 2.20 time: 0.190333 Jun 07 13:21:31.428614 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 231/448] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:31 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:32.450586 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:32.451721 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:32.459163 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:32.459691 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:32.460518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:32.461177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:32.678632 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:32.688032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:32.689716 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:32.690998 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-62c3af88-d72e-45ee-aee4-81a4738567b3 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1739 microversion: 2.20 time: 0.246112 Jun 07 13:21:32.708573 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 218/449] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:32 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:32.748712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-c6eb62aa-fa96-4e03-b9bb-fd925856fecd req-46a420ce-9cb2-47fb-877a-de5e15ca02da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2d4bcb-ea81-4550-be2e-2689fffd0943", "name": "network-vif-plugged", "status": "completed", "tag": "4846c4cd-df7f-498e-a460-3a57b147fedb"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:32.758462 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-c6eb62aa-fa96-4e03-b9bb-fd925856fecd req-46a420ce-9cb2-47fb-877a-de5e15ca02da service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:32.759465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-c6eb62aa-fa96-4e03-b9bb-fd925856fecd req-46a420ce-9cb2-47fb-877a-de5e15ca02da service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:32.773959 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-c6eb62aa-fa96-4e03-b9bb-fd925856fecd req-46a420ce-9cb2-47fb-877a-de5e15ca02da service nova] Creating event network-vif-plugged:4846c4cd-df7f-498e-a460-3a57b147fedb for instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 on hv-cinder-84460 Jun 07 13:21:32.780160 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-c6eb62aa-fa96-4e03-b9bb-fd925856fecd req-46a420ce-9cb2-47fb-877a-de5e15ca02da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Jun 07 13:21:32.780758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 232/450] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:33.708551 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:33.709242 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:33.716306 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:33.717291 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:33.718322 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:33.718843 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:33.880332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:33.889422 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:33.891188 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:33.892715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0969a1d9-d2b7-4ff1-b002-9837b33fe7d1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1739 microversion: 2.20 time: 0.188262 Jun 07 13:21:33.893283 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 219/451] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:33 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:21:34.912244 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:34.913168 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:34.920872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:34.921651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:34.922683 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:34.923194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:35.074255 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:35.089209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:35.091268 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:35.092653 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ac345f33-38bd-44b3-8566-515660a85970 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1739 microversion: 2.20 time: 0.185000 Jun 07 13:21:35.093582 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 233/452] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:34 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:36.112281 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:36.112811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:36.119255 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:36.119702 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:36.120456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:36.120889 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:36.283081 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:36.292405 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:36.301575 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:36.302820 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-37905c70-8702-4570-b0c6-9f03a989ff17 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1739 microversion: 2.20 time: 0.194496 Jun 07 13:21:36.306617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 220/453] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:36 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:37.325841 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:37.327407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:37.334381 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:37.334864 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:37.335655 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:37.336346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:37.495223 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:37.509105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:37.510783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:37.512183 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7d31c3c1-8a1f-4d1e-8dae-a799c2c7a65b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1739 microversion: 2.20 time: 0.195131 Jun 07 13:21:37.512751 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 234/454] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:37 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:38.536115 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:38.537591 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:38.544910 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:38.545973 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:38.546554 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:38.547054 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:38.702673 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:38.717901 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:38.744121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:38.745535 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b6e8387c-9712-4c0f-a223-6d786e667373 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1739 microversion: 2.20 time: 0.218443 Jun 07 13:21:38.750881 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 221/455] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:38 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:39.764829 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:39.765531 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:39.767481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=34 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:39.772801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:39.773250 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:39.774043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:39.774487 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:39.901908 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:39.910748 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:39.912283 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:39.913442 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9b9352e4-2802-469f-8021-51d1a6972b23 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1739 microversion: 2.20 time: 0.152999 Jun 07 13:21:39.913999 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 235/456] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:39 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:40.931575 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:40.932186 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:40.938722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:40.939209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:40.939961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:40.940403 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:41.076145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:41.084270 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:41.085791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:41.087032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b67d74c6-fdaf-41d7-bf11-5846fb9b99ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1721 microversion: 2.20 time: 0.159330 Jun 07 13:21:41.087601 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 222/457] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:40 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:42.106307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:42.106870 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:42.113535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:42.113990 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:42.114754 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:42.115212 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:42.248285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:42.256148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:42.257657 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:42.258813 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0b018849-6706-4e82-a09c-0ed1ec470817 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1721 microversion: 2.20 time: 0.156825 Jun 07 13:21:42.259399 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 236/458] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:42 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:43.277787 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:43.278393 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:43.285006 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:43.285502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:43.286467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:43.289108 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:43.428045 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:43.436908 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:43.439327 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:43.440495 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d671dc1a-3fea-466d-98b1-689bce3cf010 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1721 microversion: 2.20 time: 0.166511 Jun 07 13:21:43.441048 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 223/459] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:43 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:44.459161 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:44.459777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:44.465749 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:44.466203 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:44.466994 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:44.467438 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:44.596451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:44.605078 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:44.606593 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:44.607788 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5cd6541b-05ad-4f9b-8bc3-ae53ee7bcbd0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1664 microversion: 2.20 time: 0.152665 Jun 07 13:21:44.608545 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 237/460] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:44 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:44.626128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3ff0760b-7624-4378-ae94-ab7dd7250315 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "720a1939-ecd7-4992-9d0d-9536e49ece23"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:44.627210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3ff0760b-7624-4378-ae94-ab7dd7250315 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:44.634508 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3ff0760b-7624-4378-ae94-ab7dd7250315 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:44.635002 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3ff0760b-7624-4378-ae94-ab7dd7250315 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:44.635781 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3ff0760b-7624-4378-ae94-ab7dd7250315 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:44.636217 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3ff0760b-7624-4378-ae94-ab7dd7250315 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:44.649100 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-c50e68e5-e1d7-401a-b703-e796090e39b6 req-fde1fc15-6fd4-46c0-b710-72cadf23db32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2d4bcb-ea81-4550-be2e-2689fffd0943", "name": "network-vif-unplugged", "status": "completed", "tag": "4846c4cd-df7f-498e-a460-3a57b147fedb"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:44.657942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-c50e68e5-e1d7-401a-b703-e796090e39b6 req-fde1fc15-6fd4-46c0-b710-72cadf23db32 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:44.658392 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-c50e68e5-e1d7-401a-b703-e796090e39b6 req-fde1fc15-6fd4-46c0-b710-72cadf23db32 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:44.669874 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.compute.server_external_events [req-c50e68e5-e1d7-401a-b703-e796090e39b6 req-fde1fc15-6fd4-46c0-b710-72cadf23db32 service nova] Unable to find a host for instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943. Dropping event network-vif-unplugged {{(pid=117843) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 13:21:44.670822 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-c50e68e5-e1d7-401a-b703-e796090e39b6 req-fde1fc15-6fd4-46c0-b710-72cadf23db32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025546 Jun 07 13:21:44.671533 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 238/461] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 07 13:21:44.912194 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3ff0760b-7624-4378-ae94-ab7dd7250315 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.290544 Jun 07 13:21:44.912808 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 224/462] 10.222.0.61 () {62 vars in 1363 bytes} [Tue Jun 7 13:21:44 2022] POST /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments => generated 188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:21:45.030500 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9a41205f-01f9-481e-88c8-d6d20197d8f9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:45.031717 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9a41205f-01f9-481e-88c8-d6d20197d8f9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:45.037744 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a41205f-01f9-481e-88c8-d6d20197d8f9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:45.038205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a41205f-01f9-481e-88c8-d6d20197d8f9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:45.039007 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a41205f-01f9-481e-88c8-d6d20197d8f9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:45.039452 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a41205f-01f9-481e-88c8-d6d20197d8f9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:45.129340 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9a41205f-01f9-481e-88c8-d6d20197d8f9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/action" status: 202 len: 0 microversion: 2.20 time: 0.102432 Jun 07 13:21:45.130541 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 239/463] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Jun 7 13:21:45 2022] POST /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:21:45.138461 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:45.139108 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:45.145672 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:45.146119 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:45.147090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:45.147713 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:45.273544 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:45.282462 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:45.284003 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:45.286144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fa1a4ef7-6913-4267-b32f-6a7e13a521e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1750 microversion: 2.20 time: 0.151360 Jun 07 13:21:45.286733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 225/464] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:45 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:46.305453 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:46.306062 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:46.312511 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:46.312958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:46.313715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:46.314169 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:46.442420 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:46.450690 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:46.452217 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:46.453866 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3f7d746f-822b-4d2b-b143-637737c411db tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1752 microversion: 2.20 time: 0.152365 Jun 07 13:21:46.454409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 240/465] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:46 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:47.473088 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:47.473704 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:47.475706 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=30 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:47.481335 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:47.481796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:47.482571 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:47.483053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:47.613268 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:47.621734 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:47.623249 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:47.624443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3e727d23-b134-492e-b7d5-311f0cbc16a1 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.155963 Jun 07 13:21:47.625035 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 226/466] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:47 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:48.404312 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c4b21ea0-c169-405d-813c-5d9a5ccd18c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:48.404805 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c4b21ea0-c169-405d-813c-5d9a5ccd18c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:48.411192 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c4b21ea0-c169-405d-813c-5d9a5ccd18c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.411649 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c4b21ea0-c169-405d-813c-5d9a5ccd18c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.412416 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c4b21ea0-c169-405d-813c-5d9a5ccd18c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.412852 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c4b21ea0-c169-405d-813c-5d9a5ccd18c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.438240 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c4b21ea0-c169-405d-813c-5d9a5ccd18c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5/ips" status: 200 len: 151 microversion: 2.1 time: 0.037702 Jun 07 13:21:48.439708 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 241/467] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:21:48 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:48.449972 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7105f9d-8adb-4d59-8489-e37adcfa31c9"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:48.451347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:48.458754 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.459378 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.460332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.460931 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.592414 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Invalid volume: volume f7105f9d-8adb-4d59-8489-e37adcfa31c9 is already attached to instances: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: POST /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5/os-volume_attachments HTTP/1.1 Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 74 Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:21:48.598806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {"volumeAttachment": {"volumeId": "f7105f9d-8adb-4d59-8489-e37adcfa31c9"}} Jun 07 13:21:48.600453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Invalid volume: volume f7105f9d-8adb-4d59-8489-e37adcfa31c9 is already attached to instances: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'server_id': '20833de2-a8ed-47e0-a402-7d2c367a5fe5', 'body': {'volumeAttachment': {'volumeId': 'f7105f9d-8adb-4d59-8489-e37adcfa31c9'}}} Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f7105f9d-8adb-4d59-8489-e37adcfa31c9 is already attached to instances: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:21:48.601347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f7105f9d-8adb-4d59-8489-e37adcfa31c9 is already attached to instances: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:48.602947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:48.604362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:48.604362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:48.604362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:48.604362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f7105f9d-8adb-4d59-8489-e37adcfa31c9 is already attached to instances: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e Jun 07 13:21:48.604362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:21:48.605939 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 400 to user: Invalid volume: volume f7105f9d-8adb-4d59-8489-e37adcfa31c9 is already attached to instances: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:48.607498 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cf9e6f7b-dc48-4d24-935c-b93b245800ca tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.161584 Jun 07 13:21:48.608264 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 227/468] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:21:48 2022] POST /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:21:48.618099 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ae01427c-af4e-4da4-bd03-786e49591731 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:48.618610 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ae01427c-af4e-4da4-bd03-786e49591731 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:48.625407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ae01427c-af4e-4da4-bd03-786e49591731 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.626148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ae01427c-af4e-4da4-bd03-786e49591731 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.627313 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ae01427c-af4e-4da4-bd03-786e49591731 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.627909 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ae01427c-af4e-4da4-bd03-786e49591731 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.642718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:48.643565 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:48.655093 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.656792 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.658208 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.658644 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.673889 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ae01427c-af4e-4da4-bd03-786e49591731 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:21:48.816561 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ae01427c-af4e-4da4-bd03-786e49591731 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 204 len: 0 microversion: 2.1 time: 0.202564 Jun 07 13:21:48.820251 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 242/469] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:21:48 2022] DELETE /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:21:48.835686 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-66c5009b-54b5-4f31-9f85-36562d737559 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:48.836400 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-66c5009b-54b5-4f31-9f85-36562d737559 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:48.837498 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:48.848507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-66c5009b-54b5-4f31-9f85-36562d737559 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.848972 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-66c5009b-54b5-4f31-9f85-36562d737559 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.849532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:48.849761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-66c5009b-54b5-4f31-9f85-36562d737559 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:48.850201 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-66c5009b-54b5-4f31-9f85-36562d737559 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:48.852487 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:48.854386 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5c6ac9d3-fc7e-403b-91e5-db322bb0cb2d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.216067 Jun 07 13:21:48.866901 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 228/470] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:48 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:21:49.037002 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-66c5009b-54b5-4f31-9f85-36562d737559 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:49.045196 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-66c5009b-54b5-4f31-9f85-36562d737559 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.223638 Jun 07 13:21:49.046244 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 243/471] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:48 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:49.874951 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:49.874951 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:49.881140 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:49.881580 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:49.882331 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:49.882760 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:49.887053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:50.020404 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:50.029297 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:50.030808 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:50.032224 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-bdd82ef2-e835-4127-8fbb-df9369b0d10c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.162303 Jun 07 13:21:50.032934 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 229/472] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:49 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:50.064400 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3e8c7767-55fa-45f8-9cbe-32dfc2ede7fa tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:50.065106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3e8c7767-55fa-45f8-9cbe-32dfc2ede7fa tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:50.071964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e8c7767-55fa-45f8-9cbe-32dfc2ede7fa tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:50.072419 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e8c7767-55fa-45f8-9cbe-32dfc2ede7fa tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:50.073187 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e8c7767-55fa-45f8-9cbe-32dfc2ede7fa tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:50.073612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e8c7767-55fa-45f8-9cbe-32dfc2ede7fa tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:50.211054 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3e8c7767-55fa-45f8-9cbe-32dfc2ede7fa tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:50.218586 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3e8c7767-55fa-45f8-9cbe-32dfc2ede7fa tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.158099 Jun 07 13:21:50.219261 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 244/473] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:50 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:51.050143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:51.050758 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:51.057241 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.057688 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.058446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.058900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.192957 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:51.201453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:51.202984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:51.204141 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6472948b-90eb-4dc2-b148-f4ca77be50e0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.158503 Jun 07 13:21:51.204695 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 230/474] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:51 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:51.238341 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-770be83b-8b17-4916-b6dc-bc608803f978 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:51.239044 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-770be83b-8b17-4916-b6dc-bc608803f978 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:51.246211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-770be83b-8b17-4916-b6dc-bc608803f978 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.246661 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-770be83b-8b17-4916-b6dc-bc608803f978 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.247473 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-770be83b-8b17-4916-b6dc-bc608803f978 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:51.247915 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-770be83b-8b17-4916-b6dc-bc608803f978 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:51.400538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-770be83b-8b17-4916-b6dc-bc608803f978 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:51.408856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-770be83b-8b17-4916-b6dc-bc608803f978 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.175312 Jun 07 13:21:51.409429 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 245/475] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:51 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:52.222202 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:52.223010 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:52.230238 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:52.230692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:52.231702 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:52.232145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:52.370254 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:52.378969 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:52.380473 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:52.382073 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-de2a2338-14ce-4e22-9b47-d2b1caea9349 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.164376 Jun 07 13:21:52.383269 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 231/476] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:52 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:52.425523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-874903b3-f3af-4607-9cdd-7d4584714f73 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:52.426794 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-874903b3-f3af-4607-9cdd-7d4584714f73 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:52.435594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-874903b3-f3af-4607-9cdd-7d4584714f73 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:52.436351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-874903b3-f3af-4607-9cdd-7d4584714f73 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:52.437488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-874903b3-f3af-4607-9cdd-7d4584714f73 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:52.438155 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-874903b3-f3af-4607-9cdd-7d4584714f73 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:52.442975 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:52.584475 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-874903b3-f3af-4607-9cdd-7d4584714f73 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:52.591927 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-874903b3-f3af-4607-9cdd-7d4584714f73 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.170357 Jun 07 13:21:52.592498 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 246/477] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:52 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:53.400808 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:53.402531 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:53.411243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.411799 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.412673 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.413196 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.551291 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:53.560023 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:53.561653 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:53.562953 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e015eac4-0b45-4d05-92a2-4751e64f0001 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.166154 Jun 07 13:21:53.564012 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 232/478] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:53 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:21:53.609493 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3f0e6802-36b0-41fe-a7cc-451ef2c41997 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:53.610183 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3f0e6802-36b0-41fe-a7cc-451ef2c41997 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:53.616298 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3f0e6802-36b0-41fe-a7cc-451ef2c41997 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.616775 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3f0e6802-36b0-41fe-a7cc-451ef2c41997 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.617569 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3f0e6802-36b0-41fe-a7cc-451ef2c41997 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.618037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3f0e6802-36b0-41fe-a7cc-451ef2c41997 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.754004 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3f0e6802-36b0-41fe-a7cc-451ef2c41997 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:53.761758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3f0e6802-36b0-41fe-a7cc-451ef2c41997 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.156064 Jun 07 13:21:53.762612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 247/479] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:53 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:54.581565 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:54.582888 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:54.590673 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:54.591168 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:54.591937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:54.592365 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:54.776582 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:54.779243 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-57a7cce2-6b81-445f-b2c5-c9011a1a964a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:54.780716 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-57a7cce2-6b81-445f-b2c5-c9011a1a964a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:54.788822 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-57a7cce2-6b81-445f-b2c5-c9011a1a964a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:54.792798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:54.793275 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-57a7cce2-6b81-445f-b2c5-c9011a1a964a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:54.795086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:54.796281 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6d54496a-ef7b-42ee-ba4d-05ed8765f707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.218727 Jun 07 13:21:54.799860 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-57a7cce2-6b81-445f-b2c5-c9011a1a964a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:54.800698 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-57a7cce2-6b81-445f-b2c5-c9011a1a964a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:54.806277 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 233/480] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:54 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:54.997384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-57a7cce2-6b81-445f-b2c5-c9011a1a964a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:55.007028 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-57a7cce2-6b81-445f-b2c5-c9011a1a964a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.232077 Jun 07 13:21:55.020446 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 248/481] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:54 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:21:55.824166 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:55.824779 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:55.832043 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:55.832493 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:55.833256 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:55.833687 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:55.987840 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:55.996528 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:55.998027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:55.999379 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-73dc7eaa-a174-4e34-a0c8-276f9a3fd653 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.179506 Jun 07 13:21:55.999973 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 234/482] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:55 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:56.025721 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d96011f7-2ad4-4e85-ab5b-f52449a5a350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:56.026382 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d96011f7-2ad4-4e85-ab5b-f52449a5a350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:56.033132 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d96011f7-2ad4-4e85-ab5b-f52449a5a350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.033580 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d96011f7-2ad4-4e85-ab5b-f52449a5a350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.034351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d96011f7-2ad4-4e85-ab5b-f52449a5a350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.034782 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d96011f7-2ad4-4e85-ab5b-f52449a5a350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.169451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d96011f7-2ad4-4e85-ab5b-f52449a5a350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:56.177792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d96011f7-2ad4-4e85-ab5b-f52449a5a350 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.155798 Jun 07 13:21:56.178692 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 249/483] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:56 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:57.018531 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:57.019231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:57.025727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.026173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:57.026958 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.027395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:57.172485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:57.181188 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:57.182624 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:57.183827 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-70802526-f125-473d-bf7c-efcdb51bb56e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.170213 Jun 07 13:21:57.184396 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 235/484] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:57 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:57.195326 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e80b51bd-60f3-4117-8710-dbeb6570a4cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:57.195939 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e80b51bd-60f3-4117-8710-dbeb6570a4cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:57.201943 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e80b51bd-60f3-4117-8710-dbeb6570a4cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.202391 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e80b51bd-60f3-4117-8710-dbeb6570a4cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:57.203184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e80b51bd-60f3-4117-8710-dbeb6570a4cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.203610 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e80b51bd-60f3-4117-8710-dbeb6570a4cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:57.345327 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e80b51bd-60f3-4117-8710-dbeb6570a4cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:57.353512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e80b51bd-60f3-4117-8710-dbeb6570a4cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.161868 Jun 07 13:21:57.354766 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 250/485] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:57 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:58.202519 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:58.203116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:58.209575 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:58.210020 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.210770 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:58.211231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.340002 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:58.349173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:58.350673 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:58.351878 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0e17eee8-c824-4163-bea7-380df792ea05 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.153428 Jun 07 13:21:58.352697 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 236/486] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:58 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:58.370441 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-545d1763-ec34-41d2-9bc8-9122b4a004bb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:58.371087 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-545d1763-ec34-41d2-9bc8-9122b4a004bb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:58.377047 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-545d1763-ec34-41d2-9bc8-9122b4a004bb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:58.377501 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-545d1763-ec34-41d2-9bc8-9122b4a004bb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.378264 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-545d1763-ec34-41d2-9bc8-9122b4a004bb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:58.378703 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-545d1763-ec34-41d2-9bc8-9122b4a004bb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.394366 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e41fc8c5-068c-48c2-902c-9c8d2ac4d77e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9eb4a916-f70a-4982-9de6-b0c10869d6e4"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:58.395665 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e41fc8c5-068c-48c2-902c-9c8d2ac4d77e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:58.401550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e41fc8c5-068c-48c2-902c-9c8d2ac4d77e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:58.402001 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e41fc8c5-068c-48c2-902c-9c8d2ac4d77e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.402766 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e41fc8c5-068c-48c2-902c-9c8d2ac4d77e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:58.403221 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e41fc8c5-068c-48c2-902c-9c8d2ac4d77e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.697430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-545d1763-ec34-41d2-9bc8-9122b4a004bb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:58.704888 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-545d1763-ec34-41d2-9bc8-9122b4a004bb tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.338152 Jun 07 13:21:58.706023 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 251/487] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:58 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:59.369620 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:59.370237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:59.376304 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:59.376899 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:59.378057 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:59.378493 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:59.506004 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:59.514348 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:59.515882 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:59.517046 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-40556504-bbcc-406c-b25e-024da85ec3c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.151425 Jun 07 13:21:59.517603 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 252/488] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:59 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:21:59.723279 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-89854702-0363-4386-a674-3cae1404899d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:59.723823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-89854702-0363-4386-a674-3cae1404899d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:59.730082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-89854702-0363-4386-a674-3cae1404899d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:59.730532 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-89854702-0363-4386-a674-3cae1404899d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:59.731326 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-89854702-0363-4386-a674-3cae1404899d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:59.731764 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-89854702-0363-4386-a674-3cae1404899d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:59.859043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-89854702-0363-4386-a674-3cae1404899d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:59.866697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-89854702-0363-4386-a674-3cae1404899d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.147751 Jun 07 13:21:59.867292 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 253/489] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:59 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:00.535348 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:00.535940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:00.541944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:00.542388 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:00.543171 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:00.543598 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:00.665128 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:00.673313 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:00.675326 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:00.676490 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-145eaced-6192-4cda-9252-fd47ceea7bd4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.145034 Jun 07 13:22:00.677046 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 254/490] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:00 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:00.884853 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-249ad24d-6de4-4b84-8c2d-8b72fe90a7a3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:00.885498 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-249ad24d-6de4-4b84-8c2d-8b72fe90a7a3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:00.891522 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-249ad24d-6de4-4b84-8c2d-8b72fe90a7a3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:00.891970 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-249ad24d-6de4-4b84-8c2d-8b72fe90a7a3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:00.892731 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-249ad24d-6de4-4b84-8c2d-8b72fe90a7a3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:00.893178 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-249ad24d-6de4-4b84-8c2d-8b72fe90a7a3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:00.936261 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e41fc8c5-068c-48c2-902c-9c8d2ac4d77e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.546119 Jun 07 13:22:00.936947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 237/491] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:21:58 2022] POST /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments => generated 194 bytes in 2548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:22:01.037522 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-249ad24d-6de4-4b84-8c2d-8b72fe90a7a3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:01.046087 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-249ad24d-6de4-4b84-8c2d-8b72fe90a7a3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1683 microversion: 2.1 time: 0.165349 Jun 07 13:22:01.046913 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 255/492] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:00 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:01.696714 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:01.697509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:01.704081 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:01.704617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:01.706136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:01.706652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:01.846490 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-d6746b9b-2ba0-4a1d-8220-4eb9a0ecd56d req-87a6f00b-6ac1-4f15-88d4-051f4b1b7a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20833de2-a8ed-47e0-a402-7d2c367a5fe5", "name": "network-vif-deleted", "tag": "e03bee43-ba5c-48ca-bb29-489689c6a119"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:01.863106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-d6746b9b-2ba0-4a1d-8220-4eb9a0ecd56d req-87a6f00b-6ac1-4f15-88d4-051f4b1b7a63 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:01.863563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-d6746b9b-2ba0-4a1d-8220-4eb9a0ecd56d req-87a6f00b-6ac1-4f15-88d4-051f4b1b7a63 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:01.883106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-d6746b9b-2ba0-4a1d-8220-4eb9a0ecd56d req-87a6f00b-6ac1-4f15-88d4-051f4b1b7a63 service nova] Creating event network-vif-deleted:e03bee43-ba5c-48ca-bb29-489689c6a119 for instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 on hv-cinder-84460 Jun 07 13:22:01.885926 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:01.897777 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:01.899786 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:01.901588 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8847b7bc-3603-48f6-86a5-aa8578c5a088 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.209933 Jun 07 13:22:01.902698 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 238/493] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:01 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:01.910237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-d6746b9b-2ba0-4a1d-8220-4eb9a0ecd56d req-87a6f00b-6ac1-4f15-88d4-051f4b1b7a63 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057727 Jun 07 13:22:01.916204 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 256/494] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:02.063669 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:02.064284 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:02.070967 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.071611 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.072377 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.072812 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.105441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.106132 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.106747 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lazy-loading 'fault' on Instance uuid 20833de2-a8ed-47e0-a402-7d2c367a5fe5 {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:22:02.149710 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:02.157578 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-db628b08-1df5-4fbe-ba3a-6b866e37c713 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 200 len: 1332 microversion: 2.1 time: 0.097779 Jun 07 13:22:02.158401 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 239/495] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:02 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:02.921465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:02.922371 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:02.929819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.930359 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.931294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.931734 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:03.064875 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:03.075384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:03.078337 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:03.081063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-22b084e6-847d-4439-a340-40e2d93a344e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.163553 Jun 07 13:22:03.082533 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 257/496] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:02 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:03.175208 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:03.175854 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:03.182232 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.182680 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:03.183465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.183898 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:03.197406 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 HTTP/1.1 Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:22:03.198977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:22:03.200505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '20833de2-a8ed-47e0-a402-7d2c367a5fe5'} Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:03.201371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:22:03.203042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.205063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:03.205063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cad90806-dd2e-4bf5-87aa-d3daa6e4a306 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 404 len: 111 microversion: 2.1 time: 0.029154 Jun 07 13:22:03.205063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 240/497] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:03 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:22:03.211162 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-51688eff-a431-40ad-8781-0fb06a002e83 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '.version_select at 0x7f46a802aca0>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:03.229898 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-51688eff-a431-40ad-8781-0fb06a002e83 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012735776" status: 202 len: 0 microversion: 2.1 time: 0.022536 Jun 07 13:22:03.230475 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 258/498] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Jun 7 13:22:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012735776 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:22:03.953148 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-910f116a-f875-4cca-b625-d7e271f5b905 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:03.953862 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-910f116a-f875-4cca-b625-d7e271f5b905 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:03.961316 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-910f116a-f875-4cca-b625-d7e271f5b905 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.961762 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-910f116a-f875-4cca-b625-d7e271f5b905 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:03.962790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-910f116a-f875-4cca-b625-d7e271f5b905 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.963269 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-910f116a-f875-4cca-b625-d7e271f5b905 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:04.099711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:04.100334 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:04.105663 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-910f116a-f875-4cca-b625-d7e271f5b905 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lazy-loading 'services' on Instance uuid 1184d0bc-4e76-42ed-8a67-6df8ce452b2e {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:22:04.106989 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:04.107448 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:04.108234 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:04.108668 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:04.245565 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-910f116a-f875-4cca-b625-d7e271f5b905 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments/f7105f9d-8adb-4d59-8489-e37adcfa31c9" status: 202 len: 0 microversion: 2.1 time: 0.296485 Jun 07 13:22:04.249413 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 241/499] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:22:03 2022] DELETE /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments/f7105f9d-8adb-4d59-8489-e37adcfa31c9 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:22:04.256763 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-33c794eb-97de-4db5-b6ac-62240df2d9a6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:04.257916 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-33c794eb-97de-4db5-b6ac-62240df2d9a6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:04.265167 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-33c794eb-97de-4db5-b6ac-62240df2d9a6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:04.265712 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-33c794eb-97de-4db5-b6ac-62240df2d9a6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:04.266661 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-33c794eb-97de-4db5-b6ac-62240df2d9a6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:04.267210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-33c794eb-97de-4db5-b6ac-62240df2d9a6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:04.275186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:04.287302 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:04.289181 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:04.290801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e3daed97-438c-4e1f-a121-3fa301d46e50 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.195606 Jun 07 13:22:04.292054 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 259/500] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:04 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:04.302814 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-33c794eb-97de-4db5-b6ac-62240df2d9a6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051708 Jun 07 13:22:04.303344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 242/501] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:22:04 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:05.309190 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:05.309840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:05.314153 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a4c62842-0a6c-4a37-a94d-de2ac79a32d9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:05.315092 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a4c62842-0a6c-4a37-a94d-de2ac79a32d9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:05.315961 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:05.316414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:05.317184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:05.317620 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:05.321599 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a4c62842-0a6c-4a37-a94d-de2ac79a32d9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:05.322045 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a4c62842-0a6c-4a37-a94d-de2ac79a32d9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:05.322803 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a4c62842-0a6c-4a37-a94d-de2ac79a32d9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:05.323264 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a4c62842-0a6c-4a37-a94d-de2ac79a32d9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:05.357467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a4c62842-0a6c-4a37-a94d-de2ac79a32d9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047105 Jun 07 13:22:05.358033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 243/502] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:22:05 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:22:05.449291 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:05.458322 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:05.459793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:05.460954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7c94f57f-d1c6-488a-9d6c-e3d86a2d8524 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.155644 Jun 07 13:22:05.461512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 260/503] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:05 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:06.368995 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ea1e9020-2609-4c6e-9ba9-6f8209e577cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:06.370129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ea1e9020-2609-4c6e-9ba9-6f8209e577cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:06.376580 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ea1e9020-2609-4c6e-9ba9-6f8209e577cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:06.377027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ea1e9020-2609-4c6e-9ba9-6f8209e577cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:06.377798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ea1e9020-2609-4c6e-9ba9-6f8209e577cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:06.378230 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ea1e9020-2609-4c6e-9ba9-6f8209e577cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:06.381933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:06.408069 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ea1e9020-2609-4c6e-9ba9-6f8209e577cc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043050 Jun 07 13:22:06.409123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 244/504] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:22:06 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:06.479206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:06.479828 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:06.485897 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:06.486350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:06.487787 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:06.488230 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:06.617050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:06.625431 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:06.627028 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:06.628192 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0ed0de72-c345-4846-aeba-e7541064cffa tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.153274 Jun 07 13:22:06.628754 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 261/505] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:06 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:07.420028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ad82a326-05f7-4dac-9183-354bdc26791e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:07.420944 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ad82a326-05f7-4dac-9183-354bdc26791e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:07.427848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ad82a326-05f7-4dac-9183-354bdc26791e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:07.428305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ad82a326-05f7-4dac-9183-354bdc26791e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:07.429064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ad82a326-05f7-4dac-9183-354bdc26791e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:07.429494 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ad82a326-05f7-4dac-9183-354bdc26791e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:07.457896 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ad82a326-05f7-4dac-9183-354bdc26791e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041767 Jun 07 13:22:07.458444 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 245/506] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:22:07 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:07.647537 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:07.648577 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:07.655461 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:07.655920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:07.656694 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:07.657140 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:07.786052 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:07.794648 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:07.796173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:07.797337 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d6df7224-451e-4c07-a404-6472b44f71ec tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.154508 Jun 07 13:22:07.797897 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 262/507] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:07 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:08.469357 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-71923190-0266-447b-a982-4f69717629ce tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:08.469732 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f4dcaa16-7fb3-4f74-aa3c-4b594d6521f7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:08.470875 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-71923190-0266-447b-a982-4f69717629ce tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:08.471003 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f4dcaa16-7fb3-4f74-aa3c-4b594d6521f7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:08.477201 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-71923190-0266-447b-a982-4f69717629ce tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.477384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa16-7fb3-4f74-aa3c-4b594d6521f7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.478103 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa16-7fb3-4f74-aa3c-4b594d6521f7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.478222 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-71923190-0266-447b-a982-4f69717629ce tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.478985 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa16-7fb3-4f74-aa3c-4b594d6521f7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.479100 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-71923190-0266-447b-a982-4f69717629ce tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.479341 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa16-7fb3-4f74-aa3c-4b594d6521f7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.479627 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-71923190-0266-447b-a982-4f69717629ce tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.504456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-f4dcaa16-7fb3-4f74-aa3c-4b594d6521f7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lazy-loading 'flavor' on Instance uuid 3fb5d9cf-92eb-45b1-b8b5-73af66067558 {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:22:08.520119 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-71923190-0266-447b-a982-4f69717629ce tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054675 Jun 07 13:22:08.520971 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 263/508] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:22:08 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:08.631083 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f4dcaa16-7fb3-4f74-aa3c-4b594d6521f7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/action" status: 200 len: 32 microversion: 2.1 time: 0.165396 Jun 07 13:22:08.631606 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 246/509] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:22:08 2022] POST /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:22:08.640630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f10be3b4-4bf5-4877-b3fb-e2334189602e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:08.641298 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f10be3b4-4bf5-4877-b3fb-e2334189602e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:08.647672 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f10be3b4-4bf5-4877-b3fb-e2334189602e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.648323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f10be3b4-4bf5-4877-b3fb-e2334189602e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.648880 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f10be3b4-4bf5-4877-b3fb-e2334189602e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.649316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f10be3b4-4bf5-4877-b3fb-e2334189602e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.668853 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=100 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:08.788249 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f10be3b4-4bf5-4877-b3fb-e2334189602e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:08.796973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f10be3b4-4bf5-4877-b3fb-e2334189602e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.160087 Jun 07 13:22:08.798273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 264/510] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:08 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:08.815386 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:08.816278 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:08.823049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.823511 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.824549 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.825059 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.988749 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:08.999500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:09.001025 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:09.002240 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-852fc2ff-d691-405b-bf06-e16f6bdbdf73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.191198 Jun 07 13:22:09.002799 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 247/511] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:08 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:09.531643 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f3ed4cff-41dc-463a-868b-a5af7a09be4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:09.532654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f3ed4cff-41dc-463a-868b-a5af7a09be4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:09.539307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f3ed4cff-41dc-463a-868b-a5af7a09be4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.539753 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f3ed4cff-41dc-463a-868b-a5af7a09be4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.540512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f3ed4cff-41dc-463a-868b-a5af7a09be4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.540940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f3ed4cff-41dc-463a-868b-a5af7a09be4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.570423 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f3ed4cff-41dc-463a-868b-a5af7a09be4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042761 Jun 07 13:22:09.571028 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 265/512] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:22:09 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:22:09.627090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2db8546b-ae36-44f0-8afe-83269a4fd151 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:09.627589 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2db8546b-ae36-44f0-8afe-83269a4fd151 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:09.633944 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2db8546b-ae36-44f0-8afe-83269a4fd151 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.634401 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2db8546b-ae36-44f0-8afe-83269a4fd151 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.635220 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2db8546b-ae36-44f0-8afe-83269a4fd151 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.635661 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2db8546b-ae36-44f0-8afe-83269a4fd151 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.660872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2db8546b-ae36-44f0-8afe-83269a4fd151 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Going to try to terminate instance {{(pid=117842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:22:09.736730 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2db8546b-ae36-44f0-8afe-83269a4fd151 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 204 len: 0 microversion: 2.1 time: 0.113097 Jun 07 13:22:09.737525 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 248/513] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:22:09 2022] DELETE /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:22:09.745658 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0f0af3ee-9774-4304-8269-d3608b517c9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:09.746384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0f0af3ee-9774-4304-8269-d3608b517c9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:09.752404 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0f0af3ee-9774-4304-8269-d3608b517c9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.752859 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0f0af3ee-9774-4304-8269-d3608b517c9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.753616 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0f0af3ee-9774-4304-8269-d3608b517c9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.754051 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0f0af3ee-9774-4304-8269-d3608b517c9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.815071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-745fde7c-1d72-4c51-a07f-6705f6b26533 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:09.815778 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-745fde7c-1d72-4c51-a07f-6705f6b26533 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:09.821850 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-745fde7c-1d72-4c51-a07f-6705f6b26533 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.822313 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-745fde7c-1d72-4c51-a07f-6705f6b26533 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.823103 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-745fde7c-1d72-4c51-a07f-6705f6b26533 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.823547 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-745fde7c-1d72-4c51-a07f-6705f6b26533 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.912242 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0f0af3ee-9774-4304-8269-d3608b517c9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:09.920035 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0f0af3ee-9774-4304-8269-d3608b517c9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1679 microversion: 2.1 time: 0.178089 Jun 07 13:22:09.920607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 266/514] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:09 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:09.970083 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-745fde7c-1d72-4c51-a07f-6705f6b26533 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:09.978485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-745fde7c-1d72-4c51-a07f-6705f6b26533 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.167675 Jun 07 13:22:09.979086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 249/515] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:09 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:10.020419 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:10.020963 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:10.022801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:10.027998 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.028452 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.029213 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.029651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.154352 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:10.163065 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:10.164561 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:10.165711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-26f70dc2-bd3e-4421-85bb-a4522b3f7658 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.149769 Jun 07 13:22:10.166270 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 267/516] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:10 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:10.854668 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-0dbd9190-11f5-467a-90d8-2ad9368ba53e req-f3cdf939-d076-4ec6-baee-43080493d1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2d4bcb-ea81-4550-be2e-2689fffd0943", "name": "network-vif-plugged", "status": "completed", "tag": "4846c4cd-df7f-498e-a460-3a57b147fedb"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:10.864288 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-0dbd9190-11f5-467a-90d8-2ad9368ba53e req-f3cdf939-d076-4ec6-baee-43080493d1e3 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.864832 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-0dbd9190-11f5-467a-90d8-2ad9368ba53e req-f3cdf939-d076-4ec6-baee-43080493d1e3 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.876557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-0dbd9190-11f5-467a-90d8-2ad9368ba53e req-f3cdf939-d076-4ec6-baee-43080493d1e3 service nova] Creating event network-vif-plugged:4846c4cd-df7f-498e-a460-3a57b147fedb for instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 on hv-cinder-84460 Jun 07 13:22:10.881878 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-0dbd9190-11f5-467a-90d8-2ad9368ba53e req-f3cdf939-d076-4ec6-baee-43080493d1e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031150 Jun 07 13:22:10.882471 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 250/517] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:10.937014 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8a539eb3-3d88-40c4-84d6-78c0df73148c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:10.937624 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8a539eb3-3d88-40c4-84d6-78c0df73148c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:10.944369 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8a539eb3-3d88-40c4-84d6-78c0df73148c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.944814 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8a539eb3-3d88-40c4-84d6-78c0df73148c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.945569 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8a539eb3-3d88-40c4-84d6-78c0df73148c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.945999 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8a539eb3-3d88-40c4-84d6-78c0df73148c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.997394 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1e1faa74-f69d-4b1c-ae5b-b5d2b0851dcd tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:10.998086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1e1faa74-f69d-4b1c-ae5b-b5d2b0851dcd tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:11.004857 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1e1faa74-f69d-4b1c-ae5b-b5d2b0851dcd tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.005306 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1e1faa74-f69d-4b1c-ae5b-b5d2b0851dcd tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.006068 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1e1faa74-f69d-4b1c-ae5b-b5d2b0851dcd tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.006500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1e1faa74-f69d-4b1c-ae5b-b5d2b0851dcd tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.116131 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8a539eb3-3d88-40c4-84d6-78c0df73148c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:11.123772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8a539eb3-3d88-40c4-84d6-78c0df73148c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1679 microversion: 2.1 time: 0.190546 Jun 07 13:22:11.124344 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 268/518] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:10 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:11.160191 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1e1faa74-f69d-4b1c-ae5b-b5d2b0851dcd tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:11.168245 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1e1faa74-f69d-4b1c-ae5b-b5d2b0851dcd tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.175269 Jun 07 13:22:11.168806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 251/519] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:10 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:11.183546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:11.184164 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:11.190058 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.190517 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.191369 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.192316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.318368 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:11.327040 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:11.328582 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:11.329770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-daf5d003-45b7-490c-9f6a-bbb33425733e tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.150069 Jun 07 13:22:11.330324 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 269/520] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:11 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:12.141562 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3f9cc267-4a37-420e-b710-e6b6c8bfcd89 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:12.142185 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3f9cc267-4a37-420e-b710-e6b6c8bfcd89 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:12.149309 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3f9cc267-4a37-420e-b710-e6b6c8bfcd89 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.149763 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3f9cc267-4a37-420e-b710-e6b6c8bfcd89 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.150527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3f9cc267-4a37-420e-b710-e6b6c8bfcd89 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.150989 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3f9cc267-4a37-420e-b710-e6b6c8bfcd89 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.185172 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-645cf7af-fdb1-47ff-8798-f4f879e7df6b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:12.185763 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-645cf7af-fdb1-47ff-8798-f4f879e7df6b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:12.192297 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-645cf7af-fdb1-47ff-8798-f4f879e7df6b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.192743 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-645cf7af-fdb1-47ff-8798-f4f879e7df6b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.193514 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-645cf7af-fdb1-47ff-8798-f4f879e7df6b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.193946 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-645cf7af-fdb1-47ff-8798-f4f879e7df6b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.326798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-3f9cc267-4a37-420e-b710-e6b6c8bfcd89 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:12.336820 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3f9cc267-4a37-420e-b710-e6b6c8bfcd89 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1679 microversion: 2.1 time: 0.199020 Jun 07 13:22:12.337530 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 252/521] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:12.348921 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:12.349535 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:12.355807 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.356259 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.357027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.357464 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.365171 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-645cf7af-fdb1-47ff-8798-f4f879e7df6b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:12.373379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-645cf7af-fdb1-47ff-8798-f4f879e7df6b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.191855 Jun 07 13:22:12.374161 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 270/522] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:12.495454 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:12.503931 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:12.505976 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:12.507158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e682b7d5-51c6-4e2e-8702-839f21da8646 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.162549 Jun 07 13:22:12.507710 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 253/523] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:12.962367 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-65cd1bc1-1914-470f-9284-5c1822b9f74d req-a033058a-eee8-43cb-af17-7128c1b55bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1184d0bc-4e76-42ed-8a67-6df8ce452b2e", "name": "network-vif-deleted", "tag": "e938804d-36ef-4d7d-8a4a-5644b1bcebff"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:12.970375 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-65cd1bc1-1914-470f-9284-5c1822b9f74d req-a033058a-eee8-43cb-af17-7128c1b55bde service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:12.970819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-65cd1bc1-1914-470f-9284-5c1822b9f74d req-a033058a-eee8-43cb-af17-7128c1b55bde service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.982183 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-65cd1bc1-1914-470f-9284-5c1822b9f74d req-a033058a-eee8-43cb-af17-7128c1b55bde service nova] Creating event network-vif-deleted:e938804d-36ef-4d7d-8a4a-5644b1bcebff for instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e on hv-cinder-84460 Jun 07 13:22:12.987160 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-65cd1bc1-1914-470f-9284-5c1822b9f74d req-a033058a-eee8-43cb-af17-7128c1b55bde service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028406 Jun 07 13:22:12.987921 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 271/524] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:13.354735 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:13.355971 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:13.363911 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.364471 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.365354 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.365893 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.391286 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-50ae4353-a9dd-427b-a497-3329824d9203 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:13.392145 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-50ae4353-a9dd-427b-a497-3329824d9203 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:13.399348 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-50ae4353-a9dd-427b-a497-3329824d9203 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.399802 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-50ae4353-a9dd-427b-a497-3329824d9203 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.400408 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.400620 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-50ae4353-a9dd-427b-a497-3329824d9203 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.401060 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.401172 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-50ae4353-a9dd-427b-a497-3329824d9203 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.401692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lazy-loading 'fault' on Instance uuid 1184d0bc-4e76-42ed-8a67-6df8ce452b2e {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:22:13.453235 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:13.461432 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-27dc6b43-31b0-408b-81d5-c25494ffb6fc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1329 microversion: 2.1 time: 0.110937 Jun 07 13:22:13.465004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 254/525] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:13 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:13.525377 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:13.526175 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:13.532447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.533002 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.533861 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.534395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.546356 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-50ae4353-a9dd-427b-a497-3329824d9203 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:13.555058 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-50ae4353-a9dd-427b-a497-3329824d9203 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.168212 Jun 07 13:22:13.555910 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 272/526] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:13 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:13.670040 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:13.679063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:13.680561 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:13.681724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b75f41ce-b842-498c-b44c-6a90791d7abe tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.160342 Jun 07 13:22:13.682277 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 255/527] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:13 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:14.479360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:14.480650 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:14.486787 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.487269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.488033 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.488531 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.518818 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.519295 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.520285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lazy-loading 'fault' on Instance uuid 1184d0bc-4e76-42ed-8a67-6df8ce452b2e {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:22:14.559719 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:14.567958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-158aff33-f70e-4cba-9aee-51daceadf51b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 200 len: 1329 microversion: 2.1 time: 0.092719 Jun 07 13:22:14.568249 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 273/528] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:14 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:14.575786 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-11ba6b90-2aba-449b-a576-ff62385f81d3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:14.577607 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-11ba6b90-2aba-449b-a576-ff62385f81d3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:14.584892 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11ba6b90-2aba-449b-a576-ff62385f81d3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.585348 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11ba6b90-2aba-449b-a576-ff62385f81d3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.586117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11ba6b90-2aba-449b-a576-ff62385f81d3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.586557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11ba6b90-2aba-449b-a576-ff62385f81d3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.702853 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:14.703744 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:14.711044 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.711503 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.712305 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.715374 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-11ba6b90-2aba-449b-a576-ff62385f81d3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:14.719050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.724403 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-11ba6b90-2aba-449b-a576-ff62385f81d3 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.155017 Jun 07 13:22:14.724995 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 256/529] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:14 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:14.857786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:14.866644 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:14.868246 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:14.869389 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b6adb273-1325-4934-887c-1a152e753739 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1808 microversion: 2.20 time: 0.170574 Jun 07 13:22:14.869944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 274/530] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:14 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:15.584582 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:15.585196 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:15.591739 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.592187 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.592943 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.593373 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.606512 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e HTTP/1.1 Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:22:15.608126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:22:15.609597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '1184d0bc-4e76-42ed-8a67-6df8ce452b2e'} Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:15.610440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:22:15.611813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:15.613032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:15.613032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-71932b40-8038-4fbe-8726-9d51651d0c14 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 404 len: 111 microversion: 2.1 time: 0.028812 Jun 07 13:22:15.613032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 257/531] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:15 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:22:15.618696 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-42de97a2-e909-491d-a1ea-dbab44df2c00 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '.version_select at 0x7f46a3798940>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:15.636129 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-42de97a2-e909-491d-a1ea-dbab44df2c00 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22118456" status: 202 len: 0 microversion: 2.1 time: 0.021116 Jun 07 13:22:15.636703 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 275/532] 10.222.0.61 () {58 vars in 1214 bytes} [Tue Jun 7 13:22:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22118456 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:22:15.742403 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6e8fd789-4240-436a-801c-e277c3388750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:15.743085 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6e8fd789-4240-436a-801c-e277c3388750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:15.749461 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6e8fd789-4240-436a-801c-e277c3388750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.749934 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6e8fd789-4240-436a-801c-e277c3388750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.750687 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6e8fd789-4240-436a-801c-e277c3388750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.751152 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6e8fd789-4240-436a-801c-e277c3388750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.755809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:15.887687 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:15.888303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:15.894360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.895517 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.896295 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.896736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:16.081776 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6e8fd789-4240-436a-801c-e277c3388750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:16.090646 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6e8fd789-4240-436a-801c-e277c3388750 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.352607 Jun 07 13:22:16.091381 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 258/533] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:15 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:16.127699 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:16.136754 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:16.138266 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:16.139511 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6030588c-492e-459b-94cc-133d2d1bd55c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1795 microversion: 2.20 time: 0.255790 Jun 07 13:22:16.140235 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 276/534] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:15 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1795 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:22:16.410704 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b94a4f74-673f-4d4c-af75-714942ce0640 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: .version_select at 0x7f46a3583ca0>, body: {"keypair": {"name": "tempest-keypair-1789383109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUsecCxs16beVp8ZutaVODLu154bSm2Wvk2hdDIfRv71CboZaxpzGdbYFHukO1fQBK4WdOlLTp2djk8PlKvAUMbUopc+WbGqu677kfpPkbO63AqiiFQUtdO8nSfV7uqmg=="}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:16.424645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-b94a4f74-673f-4d4c-af75-714942ce0640 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:22:16.429050 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-b94a4f74-673f-4d4c-af75-714942ce0640 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for user 49c60c4956f8479fbfe93f9f85a8d497 and project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:22:16.452143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b94a4f74-673f-4d4c-af75-714942ce0640 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045595 Jun 07 13:22:16.452753 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 259/535] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:22:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:17.108404 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-86a10bd0-293f-4037-ba61-17e88cf54801 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:17.109041 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-86a10bd0-293f-4037-ba61-17e88cf54801 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:17.115380 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-86a10bd0-293f-4037-ba61-17e88cf54801 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:17.115916 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-86a10bd0-293f-4037-ba61-17e88cf54801 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:17.116774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-86a10bd0-293f-4037-ba61-17e88cf54801 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:17.117285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-86a10bd0-293f-4037-ba61-17e88cf54801 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:17.252123 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-86a10bd0-293f-4037-ba61-17e88cf54801 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:17.260469 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-86a10bd0-293f-4037-ba61-17e88cf54801 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.156209 Jun 07 13:22:17.261050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 277/536] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:17 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:17.723682 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-337672946", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7935e13c-3463-4221-bbf4-297a23e61ffb"}], "security_groups": [{"name": "tempest-securitygroup--1336079702"}], "key_name": "tempest-keypair-1789383109", "user_data": "}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:17.730979 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:17.824017 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] validate_networks() for [('7935e13c-3463-4221-bbf4-297a23e61ffb', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:22:18.174389 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:22:18.174818 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:22:18.175341 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:22:18.175745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:22:18.176780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:22:18.185615 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:18.186066 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:18.186905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:18.187347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:18.203646 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:22:18.207631 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for user 49c60c4956f8479fbfe93f9f85a8d497 and project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:22:18.218534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:22:18.220822 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:22:18.266884 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-25b33723-e9d8-4a77-9956-085fc5312bec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.547542 Jun 07 13:22:18.267533 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 260/537] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:22:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:22:18.277270 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9e76aa1a-73b8-4f2f-a6b6-a1a897dd15c3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:18.277973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e108f31f-debb-4ae8-8a3c-4774437dce11 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:18.278434 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9e76aa1a-73b8-4f2f-a6b6-a1a897dd15c3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:18.278724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e108f31f-debb-4ae8-8a3c-4774437dce11 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:18.285084 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e108f31f-debb-4ae8-8a3c-4774437dce11 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:18.286447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e108f31f-debb-4ae8-8a3c-4774437dce11 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:18.287564 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e108f31f-debb-4ae8-8a3c-4774437dce11 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:18.288260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e108f31f-debb-4ae8-8a3c-4774437dce11 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:18.336727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9e76aa1a-73b8-4f2f-a6b6-a1a897dd15c3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:18.344387 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9e76aa1a-73b8-4f2f-a6b6-a1a897dd15c3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1241 microversion: 2.1 time: 0.070809 Jun 07 13:22:18.344984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 261/538] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:18 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:18.436772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e108f31f-debb-4ae8-8a3c-4774437dce11 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:18.444783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e108f31f-debb-4ae8-8a3c-4774437dce11 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.171112 Jun 07 13:22:18.445353 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 278/539] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:18 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:19.361268 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e2b39fdd-8f50-4e2b-bce3-b86ec582b6c8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:19.362421 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e2b39fdd-8f50-4e2b-bce3-b86ec582b6c8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:19.369038 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2b39fdd-8f50-4e2b-bce3-b86ec582b6c8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:19.369497 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2b39fdd-8f50-4e2b-bce3-b86ec582b6c8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:19.370261 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2b39fdd-8f50-4e2b-bce3-b86ec582b6c8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:19.370916 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2b39fdd-8f50-4e2b-bce3-b86ec582b6c8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:19.434913 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e2b39fdd-8f50-4e2b-bce3-b86ec582b6c8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:19.442769 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e2b39fdd-8f50-4e2b-bce3-b86ec582b6c8 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1299 microversion: 2.1 time: 0.085282 Jun 07 13:22:19.443366 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 262/540] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:19 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:19.461766 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-65e440a1-e3bf-4e2d-a2f8-e8ce5a9044b0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:19.462381 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-65e440a1-e3bf-4e2d-a2f8-e8ce5a9044b0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:19.468316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65e440a1-e3bf-4e2d-a2f8-e8ce5a9044b0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:19.468769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65e440a1-e3bf-4e2d-a2f8-e8ce5a9044b0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:19.469529 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65e440a1-e3bf-4e2d-a2f8-e8ce5a9044b0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:19.469962 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-65e440a1-e3bf-4e2d-a2f8-e8ce5a9044b0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:19.599570 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-65e440a1-e3bf-4e2d-a2f8-e8ce5a9044b0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:19.607821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-65e440a1-e3bf-4e2d-a2f8-e8ce5a9044b0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.150331 Jun 07 13:22:19.608468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 279/541] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:19 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:20.460355 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4530d9cb-f0ef-4291-8e46-48e9ef9b2e09 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:20.461020 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4530d9cb-f0ef-4291-8e46-48e9ef9b2e09 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:20.468034 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4530d9cb-f0ef-4291-8e46-48e9ef9b2e09 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.468687 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4530d9cb-f0ef-4291-8e46-48e9ef9b2e09 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.469495 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4530d9cb-f0ef-4291-8e46-48e9ef9b2e09 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.469937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4530d9cb-f0ef-4291-8e46-48e9ef9b2e09 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.607007 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-57868b10-6c9b-43ad-bd9b-53b66eaaddc1 req-cccb0257-2fdc-46fa-8cc1-d3cbbbb25e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce009cf-5ec7-48ea-98dd-9488421317c2", "tag": "5b2360ca-1e30-48e4-8e27-cdc322c1bc95"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:20.609177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4530d9cb-f0ef-4291-8e46-48e9ef9b2e09 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:20.617499 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4530d9cb-f0ef-4291-8e46-48e9ef9b2e09 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1367 microversion: 2.1 time: 0.161320 Jun 07 13:22:20.625946 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 263/542] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:20 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:20.631484 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5435bdf7-7ad1-4070-bf6c-c3a68055c197 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:20.632736 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5435bdf7-7ad1-4070-bf6c-c3a68055c197 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:20.639921 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5435bdf7-7ad1-4070-bf6c-c3a68055c197 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.640499 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5435bdf7-7ad1-4070-bf6c-c3a68055c197 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.641456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5435bdf7-7ad1-4070-bf6c-c3a68055c197 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.641924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-57868b10-6c9b-43ad-bd9b-53b66eaaddc1 req-cccb0257-2fdc-46fa-8cc1-d3cbbbb25e33 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.642057 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5435bdf7-7ad1-4070-bf6c-c3a68055c197 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.642431 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-57868b10-6c9b-43ad-bd9b-53b66eaaddc1 req-cccb0257-2fdc-46fa-8cc1-d3cbbbb25e33 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.679765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-57868b10-6c9b-43ad-bd9b-53b66eaaddc1 req-cccb0257-2fdc-46fa-8cc1-d3cbbbb25e33 service nova] Creating event network-changed:5b2360ca-1e30-48e4-8e27-cdc322c1bc95 for instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 on hv-cinder-84460 Jun 07 13:22:20.692377 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-57868b10-6c9b-43ad-bd9b-53b66eaaddc1 req-cccb0257-2fdc-46fa-8cc1-d3cbbbb25e33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095525 Jun 07 13:22:20.693185 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 280/543] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:22:20.795457 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5435bdf7-7ad1-4070-bf6c-c3a68055c197 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:20.804794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5435bdf7-7ad1-4070-bf6c-c3a68055c197 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.177488 Jun 07 13:22:20.805386 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 264/544] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:20 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:21.642794 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-74fa52b3-a570-40b1-92df-220c23305a97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:21.643429 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-74fa52b3-a570-40b1-92df-220c23305a97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:21.650148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-74fa52b3-a570-40b1-92df-220c23305a97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:21.650591 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-74fa52b3-a570-40b1-92df-220c23305a97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:21.651372 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-74fa52b3-a570-40b1-92df-220c23305a97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:21.651805 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-74fa52b3-a570-40b1-92df-220c23305a97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:21.778915 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-74fa52b3-a570-40b1-92df-220c23305a97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:21.786870 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-74fa52b3-a570-40b1-92df-220c23305a97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1367 microversion: 2.1 time: 0.148317 Jun 07 13:22:21.787432 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 281/545] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:21 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:21.821795 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-629a107d-e957-4028-af98-f19f97390eb7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:21.822400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-629a107d-e957-4028-af98-f19f97390eb7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:21.828830 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-629a107d-e957-4028-af98-f19f97390eb7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:21.829277 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-629a107d-e957-4028-af98-f19f97390eb7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:21.830027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-629a107d-e957-4028-af98-f19f97390eb7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:21.830466 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-629a107d-e957-4028-af98-f19f97390eb7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:21.955262 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-629a107d-e957-4028-af98-f19f97390eb7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:21.963859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-629a107d-e957-4028-af98-f19f97390eb7 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.145887 Jun 07 13:22:21.964443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 265/546] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:21 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:22.804725 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-075fcb7d-d43f-4fb2-8e9f-9c642bd2d399 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:22.805340 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-075fcb7d-d43f-4fb2-8e9f-9c642bd2d399 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:22.811505 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-075fcb7d-d43f-4fb2-8e9f-9c642bd2d399 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.811966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-075fcb7d-d43f-4fb2-8e9f-9c642bd2d399 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:22.812722 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-075fcb7d-d43f-4fb2-8e9f-9c642bd2d399 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.813161 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-075fcb7d-d43f-4fb2-8e9f-9c642bd2d399 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:22.938667 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-075fcb7d-d43f-4fb2-8e9f-9c642bd2d399 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:22.946039 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-075fcb7d-d43f-4fb2-8e9f-9c642bd2d399 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1367 microversion: 2.1 time: 0.145943 Jun 07 13:22:22.946601 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 282/547] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:22 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:22.980247 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0590a416-47e0-4745-8000-bc24fa6308bb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:22.980855 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0590a416-47e0-4745-8000-bc24fa6308bb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:22.987234 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0590a416-47e0-4745-8000-bc24fa6308bb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.987680 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0590a416-47e0-4745-8000-bc24fa6308bb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:22.988431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0590a416-47e0-4745-8000-bc24fa6308bb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.988915 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0590a416-47e0-4745-8000-bc24fa6308bb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:23.113444 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0590a416-47e0-4745-8000-bc24fa6308bb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:23.121734 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0590a416-47e0-4745-8000-bc24fa6308bb tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.145508 Jun 07 13:22:23.122298 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 266/548] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:22 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:23.962868 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-db5399da-e2d0-4612-8dbe-9537f74eb609 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:23.963476 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-db5399da-e2d0-4612-8dbe-9537f74eb609 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:23.969662 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-db5399da-e2d0-4612-8dbe-9537f74eb609 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:23.970113 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-db5399da-e2d0-4612-8dbe-9537f74eb609 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:23.970899 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-db5399da-e2d0-4612-8dbe-9537f74eb609 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:23.971341 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-db5399da-e2d0-4612-8dbe-9537f74eb609 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:23.973936 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=100 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:24.095346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-db5399da-e2d0-4612-8dbe-9537f74eb609 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:24.103483 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-db5399da-e2d0-4612-8dbe-9537f74eb609 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1367 microversion: 2.1 time: 0.144238 Jun 07 13:22:24.104043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 283/549] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:23 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:24.138957 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5c7313cd-0097-44be-8d67-0c8ff666ae2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:24.139590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5c7313cd-0097-44be-8d67-0c8ff666ae2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:24.146063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c7313cd-0097-44be-8d67-0c8ff666ae2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:24.146510 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c7313cd-0097-44be-8d67-0c8ff666ae2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:24.147296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c7313cd-0097-44be-8d67-0c8ff666ae2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:24.147729 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c7313cd-0097-44be-8d67-0c8ff666ae2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:24.465276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5c7313cd-0097-44be-8d67-0c8ff666ae2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:24.473389 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5c7313cd-0097-44be-8d67-0c8ff666ae2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.338276 Jun 07 13:22:24.474445 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 267/550] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:24 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:25.121235 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8b11f386-a310-43a0-9065-43969dd9be29 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:25.121933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8b11f386-a310-43a0-9065-43969dd9be29 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:25.128282 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8b11f386-a310-43a0-9065-43969dd9be29 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.128785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8b11f386-a310-43a0-9065-43969dd9be29 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.129542 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8b11f386-a310-43a0-9065-43969dd9be29 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.129977 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8b11f386-a310-43a0-9065-43969dd9be29 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.256631 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8b11f386-a310-43a0-9065-43969dd9be29 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:25.264061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8b11f386-a310-43a0-9065-43969dd9be29 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1367 microversion: 2.1 time: 0.146739 Jun 07 13:22:25.264662 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 284/551] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:25 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:25.490747 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-68402664-2052-4c94-a86f-cdc456431948 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:25.491434 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-68402664-2052-4c94-a86f-cdc456431948 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:25.497811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-68402664-2052-4c94-a86f-cdc456431948 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.498262 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-68402664-2052-4c94-a86f-cdc456431948 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.499049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-68402664-2052-4c94-a86f-cdc456431948 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.499482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-68402664-2052-4c94-a86f-cdc456431948 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.626222 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-68402664-2052-4c94-a86f-cdc456431948 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:25.634586 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-68402664-2052-4c94-a86f-cdc456431948 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.147716 Jun 07 13:22:25.635201 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 268/552] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:25 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:26.281424 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-37c001ba-1e38-402d-a142-6ad349c3dde6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:26.282107 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-37c001ba-1e38-402d-a142-6ad349c3dde6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:26.288148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-37c001ba-1e38-402d-a142-6ad349c3dde6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.288663 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-37c001ba-1e38-402d-a142-6ad349c3dde6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:26.289631 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-37c001ba-1e38-402d-a142-6ad349c3dde6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.290190 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-37c001ba-1e38-402d-a142-6ad349c3dde6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:26.415566 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-37c001ba-1e38-402d-a142-6ad349c3dde6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:26.423106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-37c001ba-1e38-402d-a142-6ad349c3dde6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1367 microversion: 2.1 time: 0.145536 Jun 07 13:22:26.423678 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 285/553] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:26 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:26.652073 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e3e35a5c-b0c3-4b27-8ae1-86043788da1a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:26.652607 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e3e35a5c-b0c3-4b27-8ae1-86043788da1a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:26.659172 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3e35a5c-b0c3-4b27-8ae1-86043788da1a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.659626 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3e35a5c-b0c3-4b27-8ae1-86043788da1a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:26.660373 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3e35a5c-b0c3-4b27-8ae1-86043788da1a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.661312 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3e35a5c-b0c3-4b27-8ae1-86043788da1a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:26.792765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e3e35a5c-b0c3-4b27-8ae1-86043788da1a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:26.800675 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e3e35a5c-b0c3-4b27-8ae1-86043788da1a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1734 microversion: 2.1 time: 0.152505 Jun 07 13:22:26.801253 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 269/554] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:26 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:26.903121 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-6ffd82ae-3b3a-42e9-baaf-6e79aed5ef23 req-bdbbf830-af72-487b-9e79-f77a2de8defb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce009cf-5ec7-48ea-98dd-9488421317c2", "name": "network-vif-plugged", "status": "completed", "tag": "5b2360ca-1e30-48e4-8e27-cdc322c1bc95"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:26.911610 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-6ffd82ae-3b3a-42e9-baaf-6e79aed5ef23 req-bdbbf830-af72-487b-9e79-f77a2de8defb service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.912064 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-6ffd82ae-3b3a-42e9-baaf-6e79aed5ef23 req-bdbbf830-af72-487b-9e79-f77a2de8defb service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:26.923269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-6ffd82ae-3b3a-42e9-baaf-6e79aed5ef23 req-bdbbf830-af72-487b-9e79-f77a2de8defb service nova] Creating event network-vif-plugged:5b2360ca-1e30-48e4-8e27-cdc322c1bc95 for instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 on hv-cinder-84460 Jun 07 13:22:26.928178 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-6ffd82ae-3b3a-42e9-baaf-6e79aed5ef23 req-bdbbf830-af72-487b-9e79-f77a2de8defb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028797 Jun 07 13:22:26.928772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 286/555] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:22:27.440513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0ea5035c-ff9c-4750-bee4-efbb4fbdbb6b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:27.441151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0ea5035c-ff9c-4750-bee4-efbb4fbdbb6b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:27.447658 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ea5035c-ff9c-4750-bee4-efbb4fbdbb6b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:27.448109 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ea5035c-ff9c-4750-bee4-efbb4fbdbb6b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:27.448884 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ea5035c-ff9c-4750-bee4-efbb4fbdbb6b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:27.449311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0ea5035c-ff9c-4750-bee4-efbb4fbdbb6b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:27.573417 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0ea5035c-ff9c-4750-bee4-efbb4fbdbb6b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:27.580969 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0ea5035c-ff9c-4750-bee4-efbb4fbdbb6b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1367 microversion: 2.1 time: 0.144259 Jun 07 13:22:27.581540 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 270/556] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:27 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:27.818625 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-50187b65-cf15-4424-947c-bcfbb35cd4a0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:27.819344 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-50187b65-cf15-4424-947c-bcfbb35cd4a0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:27.825486 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-50187b65-cf15-4424-947c-bcfbb35cd4a0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:27.825937 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-50187b65-cf15-4424-947c-bcfbb35cd4a0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:27.826691 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-50187b65-cf15-4424-947c-bcfbb35cd4a0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:27.827148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-50187b65-cf15-4424-947c-bcfbb35cd4a0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:27.953269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-50187b65-cf15-4424-947c-bcfbb35cd4a0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:27.961865 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-50187b65-cf15-4424-947c-bcfbb35cd4a0 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1714 microversion: 2.1 time: 0.148031 Jun 07 13:22:27.962364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 287/557] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:27 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1714 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:28.059451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:28.059975 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:28.066301 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.066752 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.068030 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.068465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.147229 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] HTTP exception thrown: Cannot 'detach_volume' instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 while it is in vm_state rescued Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Request method failure captured: Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments/9eb4a916-f70a-4982-9de6-b0c10869d6e4 HTTP/1.1 Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARh_w5x3eyvpxmWFo09bX4TSX7lLT_QFdDuGbNXfNSwNB7Ug2bSzEg0_5-gIjvqMn5A1vi5Xw8j5s7JEtRkwMs4XaMuLBw0pPzIbLaotV0Qulk_SIiHBUsGrk51-OZ_-x0oYSlJal38kNshd-TA2kCT8m4QD4_whvIVBFX_68qnus Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:22:28.148711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: dcf5286e9ca14f56905e6e247e411896 Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:22:28.150276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Cannot 'detach_volume' instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 while it is in vm_state rescued Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'server_id': '3fb5d9cf-92eb-45b1-b8b5-73af66067558', 'id': '9eb4a916-f70a-4982-9de6-b0c10869d6e4'} Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:28.151125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 while it is in vm_state rescued Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 while it is in vm_state rescued Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:22:28.152585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Returning 409 to user: Cannot 'detach_volume' instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 while it is in vm_state rescued {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:28.153815 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5eeae066-c592-4261-8e62-b031ff58c07e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments/9eb4a916-f70a-4982-9de6-b0c10869d6e4" status: 409 len: 152 microversion: 2.1 time: 0.095026 Jun 07 13:22:28.153815 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 271/558] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:22:28 2022] DELETE /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments/9eb4a916-f70a-4982-9de6-b0c10869d6e4 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 13:22:28.159458 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-921169cb-e523-4ccc-bdad-61a8c8556c2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:28.159996 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-921169cb-e523-4ccc-bdad-61a8c8556c2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:28.166158 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-921169cb-e523-4ccc-bdad-61a8c8556c2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.166621 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-921169cb-e523-4ccc-bdad-61a8c8556c2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.167491 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-921169cb-e523-4ccc-bdad-61a8c8556c2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.167951 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-921169cb-e523-4ccc-bdad-61a8c8556c2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.231939 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-921169cb-e523-4ccc-bdad-61a8c8556c2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "POST /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/action" status: 202 len: 0 microversion: 2.1 time: 0.076185 Jun 07 13:22:28.233151 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 288/559] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:22:28 2022] POST /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:22:28.240900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c11d94aa-f012-4077-a97e-09ee3e1741ab tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:28.241534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c11d94aa-f012-4077-a97e-09ee3e1741ab tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:28.243668 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:28.250281 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c11d94aa-f012-4077-a97e-09ee3e1741ab tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.250807 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c11d94aa-f012-4077-a97e-09ee3e1741ab tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.251590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c11d94aa-f012-4077-a97e-09ee3e1741ab tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.252016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c11d94aa-f012-4077-a97e-09ee3e1741ab tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.341280 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=12 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:28.385425 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c11d94aa-f012-4077-a97e-09ee3e1741ab tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:28.393073 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c11d94aa-f012-4077-a97e-09ee3e1741ab tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1722 microversion: 2.1 time: 0.156252 Jun 07 13:22:28.394409 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 272/560] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:28 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:28.598876 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6f924bc2-b78c-42ae-b726-c4f01a84a148 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:28.599645 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6f924bc2-b78c-42ae-b726-c4f01a84a148 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:28.606154 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f924bc2-b78c-42ae-b726-c4f01a84a148 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.606606 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f924bc2-b78c-42ae-b726-c4f01a84a148 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.607409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f924bc2-b78c-42ae-b726-c4f01a84a148 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.607846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f924bc2-b78c-42ae-b726-c4f01a84a148 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.735103 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6f924bc2-b78c-42ae-b726-c4f01a84a148 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:28.743168 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6f924bc2-b78c-42ae-b726-c4f01a84a148 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1367 microversion: 2.1 time: 0.149058 Jun 07 13:22:28.743675 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 289/561] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:28 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:29.410793 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c45de67d-ec09-4405-8e5a-58032dbbc181 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:29.411424 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c45de67d-ec09-4405-8e5a-58032dbbc181 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:29.417887 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c45de67d-ec09-4405-8e5a-58032dbbc181 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:29.418334 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c45de67d-ec09-4405-8e5a-58032dbbc181 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:29.419125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c45de67d-ec09-4405-8e5a-58032dbbc181 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:29.419557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c45de67d-ec09-4405-8e5a-58032dbbc181 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:29.548257 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c45de67d-ec09-4405-8e5a-58032dbbc181 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:29.556276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c45de67d-ec09-4405-8e5a-58032dbbc181 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1722 microversion: 2.1 time: 0.149435 Jun 07 13:22:29.556840 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 273/562] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:29 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:29.761325 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-23a02602-4ad6-42c7-83fe-fb936b9bfb63 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:29.762112 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-23a02602-4ad6-42c7-83fe-fb936b9bfb63 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:29.768229 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-23a02602-4ad6-42c7-83fe-fb936b9bfb63 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:29.768684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-23a02602-4ad6-42c7-83fe-fb936b9bfb63 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:29.769446 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-23a02602-4ad6-42c7-83fe-fb936b9bfb63 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:29.770322 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-23a02602-4ad6-42c7-83fe-fb936b9bfb63 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:29.902272 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-23a02602-4ad6-42c7-83fe-fb936b9bfb63 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:29.909911 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-23a02602-4ad6-42c7-83fe-fb936b9bfb63 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1367 microversion: 2.1 time: 0.153083 Jun 07 13:22:29.910496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 290/563] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:29 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:30.573953 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a79264c6-b89f-48f3-9e53-ce0c27a3490d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:30.574558 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a79264c6-b89f-48f3-9e53-ce0c27a3490d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:30.581096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a79264c6-b89f-48f3-9e53-ce0c27a3490d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:30.581544 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a79264c6-b89f-48f3-9e53-ce0c27a3490d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:30.582303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a79264c6-b89f-48f3-9e53-ce0c27a3490d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:30.582795 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a79264c6-b89f-48f3-9e53-ce0c27a3490d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:30.706048 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a79264c6-b89f-48f3-9e53-ce0c27a3490d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:30.714076 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a79264c6-b89f-48f3-9e53-ce0c27a3490d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1722 microversion: 2.1 time: 0.143974 Jun 07 13:22:30.714641 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 274/564] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:30 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:30.926090 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cd55a899-f214-46ba-a7bc-bb8da084f4a5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:30.927342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-cd55a899-f214-46ba-a7bc-bb8da084f4a5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:30.933343 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cd55a899-f214-46ba-a7bc-bb8da084f4a5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:30.933796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cd55a899-f214-46ba-a7bc-bb8da084f4a5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:30.934558 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cd55a899-f214-46ba-a7bc-bb8da084f4a5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:30.935037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cd55a899-f214-46ba-a7bc-bb8da084f4a5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:31.069633 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-cd55a899-f214-46ba-a7bc-bb8da084f4a5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:31.077041 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-cd55a899-f214-46ba-a7bc-bb8da084f4a5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1557 microversion: 2.1 time: 0.154736 Jun 07 13:22:31.077601 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 291/565] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:30 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:31.093072 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3b7ab65e-9cfa-4151-ad63-936fae5ca064 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:31.093555 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3b7ab65e-9cfa-4151-ad63-936fae5ca064 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:31.100061 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b7ab65e-9cfa-4151-ad63-936fae5ca064 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:31.100505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b7ab65e-9cfa-4151-ad63-936fae5ca064 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:31.101256 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b7ab65e-9cfa-4151-ad63-936fae5ca064 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:31.101684 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b7ab65e-9cfa-4151-ad63-936fae5ca064 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:31.176547 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3b7ab65e-9cfa-4151-ad63-936fae5ca064 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087097 Jun 07 13:22:31.177769 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 275/566] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Jun 7 13:22:31 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:31.731728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9619cc6a-4f3e-403f-a63b-f6f7117b34b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:31.732285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9619cc6a-4f3e-403f-a63b-f6f7117b34b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:31.738276 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9619cc6a-4f3e-403f-a63b-f6f7117b34b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:31.738733 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9619cc6a-4f3e-403f-a63b-f6f7117b34b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:31.740170 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9619cc6a-4f3e-403f-a63b-f6f7117b34b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:31.740609 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9619cc6a-4f3e-403f-a63b-f6f7117b34b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:31.941249 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9619cc6a-4f3e-403f-a63b-f6f7117b34b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:31.949445 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9619cc6a-4f3e-403f-a63b-f6f7117b34b1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1722 microversion: 2.1 time: 0.221957 Jun 07 13:22:31.950219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 292/567] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:31 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:32.144059 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-a6fce305-cafc-4df2-84a1-4de08421ba0e req-c2b73d99-1f35-42cd-81f3-e41d2ed47a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce009cf-5ec7-48ea-98dd-9488421317c2", "tag": "5b2360ca-1e30-48e4-8e27-cdc322c1bc95"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:32.152649 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-a6fce305-cafc-4df2-84a1-4de08421ba0e req-c2b73d99-1f35-42cd-81f3-e41d2ed47a66 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:32.153088 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-a6fce305-cafc-4df2-84a1-4de08421ba0e req-c2b73d99-1f35-42cd-81f3-e41d2ed47a66 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:32.164473 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-a6fce305-cafc-4df2-84a1-4de08421ba0e req-c2b73d99-1f35-42cd-81f3-e41d2ed47a66 service nova] Creating event network-changed:5b2360ca-1e30-48e4-8e27-cdc322c1bc95 for instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 on hv-cinder-84460 Jun 07 13:22:32.169570 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-a6fce305-cafc-4df2-84a1-4de08421ba0e req-c2b73d99-1f35-42cd-81f3-e41d2ed47a66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029541 Jun 07 13:22:32.170170 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 276/568] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:32.966562 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-83eccef3-a523-4c52-a9e8-58cacc1f8877 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:32.967198 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-83eccef3-a523-4c52-a9e8-58cacc1f8877 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:32.973397 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-83eccef3-a523-4c52-a9e8-58cacc1f8877 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:32.973847 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-83eccef3-a523-4c52-a9e8-58cacc1f8877 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:32.974598 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-83eccef3-a523-4c52-a9e8-58cacc1f8877 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:32.975093 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-83eccef3-a523-4c52-a9e8-58cacc1f8877 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:33.111430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-83eccef3-a523-4c52-a9e8-58cacc1f8877 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:33.119987 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-83eccef3-a523-4c52-a9e8-58cacc1f8877 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1728 microversion: 2.1 time: 0.157323 Jun 07 13:22:33.120555 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 293/569] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:32 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:33.137301 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-951afa4b-31b3-49cf-bc5d-2cb67889c38c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:33.137877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-951afa4b-31b3-49cf-bc5d-2cb67889c38c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:33.144291 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-951afa4b-31b3-49cf-bc5d-2cb67889c38c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:33.144914 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-951afa4b-31b3-49cf-bc5d-2cb67889c38c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:33.145493 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-951afa4b-31b3-49cf-bc5d-2cb67889c38c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:33.145929 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-951afa4b-31b3-49cf-bc5d-2cb67889c38c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:33.229621 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-951afa4b-31b3-49cf-bc5d-2cb67889c38c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096473 Jun 07 13:22:33.230249 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 277/570] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Jun 7 13:22:33 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:34.265392 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-dc035f9c-05be-4179-987c-4a6cd4333072 req-ce706b7a-7bb3-43fb-a6d9-4642a4c6df0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb5d9cf-92eb-45b1-b8b5-73af66067558", "tag": "541e0200-55c0-4b40-a06e-d6fcf5d21cf5"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:34.274247 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-dc035f9c-05be-4179-987c-4a6cd4333072 req-ce706b7a-7bb3-43fb-a6d9-4642a4c6df0b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:34.274841 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-dc035f9c-05be-4179-987c-4a6cd4333072 req-ce706b7a-7bb3-43fb-a6d9-4642a4c6df0b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:34.285994 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-dc035f9c-05be-4179-987c-4a6cd4333072 req-ce706b7a-7bb3-43fb-a6d9-4642a4c6df0b service nova] Creating event network-changed:541e0200-55c0-4b40-a06e-d6fcf5d21cf5 for instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 on hv-cinder-84460 Jun 07 13:22:34.292503 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-dc035f9c-05be-4179-987c-4a6cd4333072 req-ce706b7a-7bb3-43fb-a6d9-4642a4c6df0b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030930 Jun 07 13:22:34.293273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 294/571] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:36.307244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-8ab75d7e-08e6-4902-9477-a34fe9836b42 req-9bdb56b3-b31e-491e-acfa-ec4c8273a50d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb5d9cf-92eb-45b1-b8b5-73af66067558", "tag": "541e0200-55c0-4b40-a06e-d6fcf5d21cf5"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:36.315309 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-8ab75d7e-08e6-4902-9477-a34fe9836b42 req-9bdb56b3-b31e-491e-acfa-ec4c8273a50d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:36.315753 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-8ab75d7e-08e6-4902-9477-a34fe9836b42 req-9bdb56b3-b31e-491e-acfa-ec4c8273a50d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:36.328341 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-8ab75d7e-08e6-4902-9477-a34fe9836b42 req-9bdb56b3-b31e-491e-acfa-ec4c8273a50d service nova] Creating event network-changed:541e0200-55c0-4b40-a06e-d6fcf5d21cf5 for instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 on hv-cinder-84460 Jun 07 13:22:36.333283 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-8ab75d7e-08e6-4902-9477-a34fe9836b42 req-9bdb56b3-b31e-491e-acfa-ec4c8273a50d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030260 Jun 07 13:22:36.333886 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 278/572] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:55.379429 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3bae321e-7cf8-402e-bb48-03f17c223c02 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:55.380638 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3bae321e-7cf8-402e-bb48-03f17c223c02 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:55.382747 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:55.383414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:55.390675 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3bae321e-7cf8-402e-bb48-03f17c223c02 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.391167 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3bae321e-7cf8-402e-bb48-03f17c223c02 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.391937 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3bae321e-7cf8-402e-bb48-03f17c223c02 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.392382 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3bae321e-7cf8-402e-bb48-03f17c223c02 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.430184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3bae321e-7cf8-402e-bb48-03f17c223c02 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments/720a1939-ecd7-4992-9d0d-9536e49ece23" status: 200 len: 194 microversion: 2.20 time: 0.055098 Jun 07 13:22:55.430803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 295/573] 10.222.0.61 () {60 vars in 1453 bytes} [Tue Jun 7 13:22:55 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments/720a1939-ecd7-4992-9d0d-9536e49ece23 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:22:55.493950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-511114b5-6bd0-4551-aaa2-87f70c48e6c6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:55.494536 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-511114b5-6bd0-4551-aaa2-87f70c48e6c6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:55.497793 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:55.498429 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=96 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:55.503744 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-511114b5-6bd0-4551-aaa2-87f70c48e6c6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.504200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-511114b5-6bd0-4551-aaa2-87f70c48e6c6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.505625 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-511114b5-6bd0-4551-aaa2-87f70c48e6c6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.506068 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-511114b5-6bd0-4551-aaa2-87f70c48e6c6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.585866 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-511114b5-6bd0-4551-aaa2-87f70c48e6c6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lazy-loading 'services' on Instance uuid 9a2d4bcb-ea81-4550-be2e-2689fffd0943 {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:22:55.656514 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-511114b5-6bd0-4551-aaa2-87f70c48e6c6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments/720a1939-ecd7-4992-9d0d-9536e49ece23" status: 202 len: 0 microversion: 2.20 time: 0.167327 Jun 07 13:22:55.657084 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 279/574] 10.222.0.61 () {60 vars in 1456 bytes} [Tue Jun 7 13:22:55 2022] DELETE /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments/720a1939-ecd7-4992-9d0d-9536e49ece23 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:22:55.667117 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f8f0d310-234c-4543-a3be-00bf59c731b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:55.668123 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f8f0d310-234c-4543-a3be-00bf59c731b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:55.674497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f8f0d310-234c-4543-a3be-00bf59c731b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.675133 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f8f0d310-234c-4543-a3be-00bf59c731b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.676056 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f8f0d310-234c-4543-a3be-00bf59c731b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.677281 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f8f0d310-234c-4543-a3be-00bf59c731b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.710063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f8f0d310-234c-4543-a3be-00bf59c731b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048036 Jun 07 13:22:55.710787 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 296/575] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Jun 7 13:22:55 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:22:56.722783 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f1aa6839-8903-41a6-bf83-955a2ee206a9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:56.723798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f1aa6839-8903-41a6-bf83-955a2ee206a9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:56.730291 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f1aa6839-8903-41a6-bf83-955a2ee206a9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:56.730746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f1aa6839-8903-41a6-bf83-955a2ee206a9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:56.731527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f1aa6839-8903-41a6-bf83-955a2ee206a9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:56.731962 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f1aa6839-8903-41a6-bf83-955a2ee206a9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:56.760412 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f1aa6839-8903-41a6-bf83-955a2ee206a9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042557 Jun 07 13:22:56.760965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 280/576] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Jun 7 13:22:56 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:56.815992 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c0a43659-67b2-4ce9-b9ce-2de41d5d0330 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:56.816481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c0a43659-67b2-4ce9-b9ce-2de41d5d0330 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:56.823075 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c0a43659-67b2-4ce9-b9ce-2de41d5d0330 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:56.823520 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c0a43659-67b2-4ce9-b9ce-2de41d5d0330 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:56.824269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c0a43659-67b2-4ce9-b9ce-2de41d5d0330 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:56.824700 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c0a43659-67b2-4ce9-b9ce-2de41d5d0330 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:56.848203 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c0a43659-67b2-4ce9-b9ce-2de41d5d0330 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:22:56.920072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c0a43659-67b2-4ce9-b9ce-2de41d5d0330 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 204 len: 0 microversion: 2.20 time: 0.107670 Jun 07 13:22:56.920646 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 297/577] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Jun 7 13:22:56 2022] DELETE /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:22:56.930426 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:56.931075 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:56.936942 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:56.937386 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:56.938134 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:56.938563 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:57.063156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:57.071710 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:57.073249 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:57.074401 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4ce238ea-077e-45be-b755-1be34a3ece53 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.149414 Jun 07 13:22:57.074980 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 281/578] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:56 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:58.093036 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:58.093765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:58.100194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:58.100637 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:58.101387 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:58.101817 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:58.229602 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:58.237447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:58.238982 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:58.240135 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4788cafa-3dad-40bb-aeee-6dd83323bc76 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.151352 Jun 07 13:22:58.240687 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 298/579] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:58 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:59.258322 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:59.258959 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:59.265721 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:59.266164 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:59.267028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:59.267460 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:59.554569 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:59.564578 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:59.566406 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:59.568112 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7fea419d-0a91-4ca8-b1d9-510cd23aeea2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 200 len: 1723 microversion: 2.20 time: 0.313470 Jun 07 13:22:59.568663 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 282/580] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:59 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:22:59.852796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-b1111402-6b32-459c-af3a-b5141ab1204c req-786dbef1-7d62-4f0d-8846-41d5822efcdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2d4bcb-ea81-4550-be2e-2689fffd0943", "name": "network-vif-deleted", "tag": "4846c4cd-df7f-498e-a460-3a57b147fedb"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:59.862970 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-b1111402-6b32-459c-af3a-b5141ab1204c req-786dbef1-7d62-4f0d-8846-41d5822efcdb service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:59.863683 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-b1111402-6b32-459c-af3a-b5141ab1204c req-786dbef1-7d62-4f0d-8846-41d5822efcdb service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:59.879428 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-b1111402-6b32-459c-af3a-b5141ab1204c req-786dbef1-7d62-4f0d-8846-41d5822efcdb service nova] Creating event network-vif-deleted:4846c4cd-df7f-498e-a460-3a57b147fedb for instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 on hv-cinder-84460 Jun 07 13:22:59.888271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-b1111402-6b32-459c-af3a-b5141ab1204c req-786dbef1-7d62-4f0d-8846-41d5822efcdb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038228 Jun 07 13:22:59.889640 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 299/581] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:00.586050 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:00.586667 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:00.593259 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:00.593715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:00.594490 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:00.594952 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:00.609607 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] HTTP exception thrown: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Request method failure captured: Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 HTTP/1.1 Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1BV_EOo5J6WhvRhMPFjDG8m-YtfeA6ektvI1TYliskn96EvbrJudbmoUiU519DzSrJuLqbwYUW55XC7rJcRbtFfV6QlYc8UH2Ja4x4xyytpCDwU3dLzLYhRsRkQv2Qvw0lusDXqOj-uohX-vR_OhHNUgjXBOp2n3q6d0dsxeOFBG3s Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:23:00.611287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 326e0d70244f46059664a135aefab0f0 Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:23:00.612791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '9a2d4bcb-ea81-4550-be2e-2689fffd0943'} Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:23:00.613577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:23:00.614950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:00.616090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Returning 404 to user: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:23:00.616090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cf9a48ad-6cd2-4367-b06f-f924a88f6097 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 404 len: 111 microversion: 2.20 time: 0.031120 Jun 07 13:23:00.616090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 283/582] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:00 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:23:00.622441 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4ae4dab1-e3a2-4713-aeb0-ad74549b40f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '.version_select at 0x7f46a372b280>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:00.640152 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4ae4dab1-e3a2-4713-aeb0-ad74549b40f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-893387912" status: 204 len: 0 microversion: 2.20 time: 0.021823 Jun 07 13:23:00.640739 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 300/583] 10.222.0.61 () {60 vars in 1258 bytes} [Tue Jun 7 13:23:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-893387912 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:23:01.283446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-aa6d46e1-b3d5-4ec0-89b2-b3170441757f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'create', calling method: .version_select at 0x7f46a35834c0>, body: {"keypair": {"name": "tempest-keypair-1380928719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn0aq1C9+B6VSnwWd5+u9N215otkfOv7nxJsnIivEHYP2SJWbr5uBJ/UUODJvNZLAQiSCMj4xpzgEX5iAlo4rsd7lEJqMZuVl8ylA2jo75L5i1rCPhEDjZdR5Mu8+KbPA=="}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:01.300931 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-aa6d46e1-b3d5-4ec0-89b2-b3170441757f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Getting quotas for project 346889f9c6334aa9a22bd277aa002a0f. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:01.305208 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-aa6d46e1-b3d5-4ec0-89b2-b3170441757f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Getting quotas for user 326e0d70244f46059664a135aefab0f0 and project 346889f9c6334aa9a22bd277aa002a0f. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:01.326423 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-aa6d46e1-b3d5-4ec0-89b2-b3170441757f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049729 Jun 07 13:23:01.327028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 284/584] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Jun 7 13:23:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 13:23:02.577043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1122034685", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3f69c49-b140-4944-b465-9f2708e8aff6"}], "security_groups": [{"name": "tempest-securitygroup--596900939"}], "key_name": "tempest-keypair-1380928719", "user_data": "}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:02.770950 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] validate_networks() for [('f3f69c49-b140-4944-b465-9f2708e8aff6', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:23:03.160715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:23:03.161136 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:23:03.162110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:23:03.162517 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:23:03.162983 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:23:03.171696 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:03.172142 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:03.172937 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:03.173368 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:03.191906 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Getting quotas for project 346889f9c6334aa9a22bd277aa002a0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:03.195767 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Getting quotas for user 326e0d70244f46059664a135aefab0f0 and project 346889f9c6334aa9a22bd277aa002a0f. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:03.206306 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:23:03.208617 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:23:03.255716 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5f4bba78-1b39-442f-b8e9-2c8cd444badf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.682894 Jun 07 13:23:03.256349 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 301/585] 10.222.0.61 () {62 vars in 1187 bytes} [Tue Jun 7 13:23:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 13:23:03.266850 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-62ebbac8-8ef1-4fee-8d60-31df85018054 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:03.267465 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-62ebbac8-8ef1-4fee-8d60-31df85018054 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:03.321147 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-62ebbac8-8ef1-4fee-8d60-31df85018054 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:03.329219 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-62ebbac8-8ef1-4fee-8d60-31df85018054 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:03.330871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-62ebbac8-8ef1-4fee-8d60-31df85018054 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:03.332126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-62ebbac8-8ef1-4fee-8d60-31df85018054 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1282 microversion: 2.20 time: 0.069731 Jun 07 13:23:03.332873 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 285/586] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:03 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:04.349747 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:04.351148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:04.358620 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.359313 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.360254 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.360973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.430361 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:04.436176 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:04.438046 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:04.439551 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-768f84fa-e6cc-4968-ad74-621e51beb4d0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1342 microversion: 2.20 time: 0.093652 Jun 07 13:23:04.440582 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 302/587] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:04 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1342 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:05.457725 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:05.458352 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:05.466503 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:05.467247 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:05.468227 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:05.468680 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:05.622352 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:05.630905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:05.632949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:05.634053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cdbfa96d-1c4b-4cd6-b604-dfe57060c18f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1407 microversion: 2.20 time: 0.180375 Jun 07 13:23:05.634615 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 286/588] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:05 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:06.422629 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-2683895c-fbf3-43e8-a4d1-f035c9464c0c req-a905ff0a-b2c0-4f9b-ac87-abbeef51f87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c812d20c-e7fd-49b1-9813-91433ee35219", "tag": "1df72142-8d3b-4965-899a-3271031c03d3"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:06.435729 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-2683895c-fbf3-43e8-a4d1-f035c9464c0c req-a905ff0a-b2c0-4f9b-ac87-abbeef51f87b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:06.437554 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-2683895c-fbf3-43e8-a4d1-f035c9464c0c req-a905ff0a-b2c0-4f9b-ac87-abbeef51f87b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:06.456602 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-2683895c-fbf3-43e8-a4d1-f035c9464c0c req-a905ff0a-b2c0-4f9b-ac87-abbeef51f87b service nova] Creating event network-changed:1df72142-8d3b-4965-899a-3271031c03d3 for instance c812d20c-e7fd-49b1-9813-91433ee35219 on hv-cinder-84460 Jun 07 13:23:06.462070 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-2683895c-fbf3-43e8-a4d1-f035c9464c0c req-a905ff0a-b2c0-4f9b-ac87-abbeef51f87b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050778 Jun 07 13:23:06.462659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 303/589] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:06.652849 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:06.653494 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:06.659967 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:06.660419 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:06.661176 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:06.661611 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:06.798490 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:06.807592 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:06.809170 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:06.810305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ecdc9420-403e-444a-9572-943a140fc48c tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1407 microversion: 2.20 time: 0.161420 Jun 07 13:23:06.810888 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 287/590] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:06 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:07.828648 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:07.829342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:07.835567 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:07.836017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:07.836774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:07.837209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:07.966903 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:07.974759 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:07.976844 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:07.977957 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-842eede0-4e5e-4b32-b6d4-6ec0b348c5a4 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1407 microversion: 2.20 time: 0.153599 Jun 07 13:23:07.978509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 304/591] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:07 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:08.996240 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:08.996856 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:09.003316 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:09.003767 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:09.004532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:09.004967 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:09.130053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:09.137887 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:09.139471 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:09.140586 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d6002dbd-efbe-4e69-a746-de7f756a8293 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1407 microversion: 2.20 time: 0.148272 Jun 07 13:23:09.141145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 288/592] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:08 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:10.157434 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:10.158175 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:10.164243 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:10.164693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:10.165452 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:10.165887 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:10.288491 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:10.296411 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:10.297922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:10.299071 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-dcbf3de1-ddf7-43f7-b299-e143deb402d9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1407 microversion: 2.20 time: 0.145545 Jun 07 13:23:10.299630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 305/593] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:10 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:11.317431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:11.317972 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:11.324964 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:11.325578 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:11.328765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:11.328765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:11.455973 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:11.464778 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:11.466290 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:11.467445 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5fa6a0d8-5828-4bcb-8a50-6a1d4e514a1f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1407 microversion: 2.20 time: 0.154037 Jun 07 13:23:11.468006 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 289/594] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:11 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:12.388370 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-96228092-f348-43f9-aae1-acb717de04d5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:12.388866 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-96228092-f348-43f9-aae1-acb717de04d5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:12.394892 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96228092-f348-43f9-aae1-acb717de04d5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.395348 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96228092-f348-43f9-aae1-acb717de04d5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.396111 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96228092-f348-43f9-aae1-acb717de04d5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.396555 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96228092-f348-43f9-aae1-acb717de04d5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.485604 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:12.486248 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:12.492875 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.493264 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.494032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.494474 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.516543 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-96228092-f348-43f9-aae1-acb717de04d5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lazy-loading 'services' on Instance uuid 3fb5d9cf-92eb-45b1-b8b5-73af66067558 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:23:12.623964 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:12.630274 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-96228092-f348-43f9-aae1-acb717de04d5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments/9eb4a916-f70a-4982-9de6-b0c10869d6e4" status: 202 len: 0 microversion: 2.1 time: 0.245657 Jun 07 13:23:12.630886 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 306/595] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:23:12 2022] DELETE /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments/9eb4a916-f70a-4982-9de6-b0c10869d6e4 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:23:12.631922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:12.633436 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:12.634526 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b8ec3bea-41c1-44a1-bd94-0dff96f7583f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1407 microversion: 2.20 time: 0.152797 Jun 07 13:23:12.635086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 290/596] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:12 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:23:12.639568 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-09a94626-5134-4b77-85c7-53f6d55ced2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:12.640598 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-09a94626-5134-4b77-85c7-53f6d55ced2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:12.646690 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-09a94626-5134-4b77-85c7-53f6d55ced2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.647663 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-09a94626-5134-4b77-85c7-53f6d55ced2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.648430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-09a94626-5134-4b77-85c7-53f6d55ced2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.648867 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-09a94626-5134-4b77-85c7-53f6d55ced2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.677649 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-09a94626-5134-4b77-85c7-53f6d55ced2b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042181 Jun 07 13:23:12.678248 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 307/597] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:12 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:13.175602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-d0472c44-8d1d-4795-a170-5fe131db2019 req-72c371f6-b042-4495-9d1b-a0ab2f43bd1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c812d20c-e7fd-49b1-9813-91433ee35219", "name": "network-vif-plugged", "status": "completed", "tag": "1df72142-8d3b-4965-899a-3271031c03d3"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:13.184300 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-d0472c44-8d1d-4795-a170-5fe131db2019 req-72c371f6-b042-4495-9d1b-a0ab2f43bd1b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:13.184745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-d0472c44-8d1d-4795-a170-5fe131db2019 req-72c371f6-b042-4495-9d1b-a0ab2f43bd1b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:13.196808 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-d0472c44-8d1d-4795-a170-5fe131db2019 req-72c371f6-b042-4495-9d1b-a0ab2f43bd1b service nova] Creating event network-vif-plugged:1df72142-8d3b-4965-899a-3271031c03d3 for instance c812d20c-e7fd-49b1-9813-91433ee35219 on hv-cinder-84460 Jun 07 13:23:13.201809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-d0472c44-8d1d-4795-a170-5fe131db2019 req-72c371f6-b042-4495-9d1b-a0ab2f43bd1b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029965 Jun 07 13:23:13.202418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 291/598] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:13.649580 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:13.651299 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=6 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:13.657603 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:13.658433 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:13.665188 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:13.665644 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:13.666412 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:13.667011 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:13.686354 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=6 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:13.691181 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cc63a996-b2f5-477e-8a6d-3d45c53d6208 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:13.692182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cc63a996-b2f5-477e-8a6d-3d45c53d6208 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:13.699242 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cc63a996-b2f5-477e-8a6d-3d45c53d6208 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:13.699694 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cc63a996-b2f5-477e-8a6d-3d45c53d6208 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:13.700457 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cc63a996-b2f5-477e-8a6d-3d45c53d6208 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:13.700888 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cc63a996-b2f5-477e-8a6d-3d45c53d6208 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:13.731312 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cc63a996-b2f5-477e-8a6d-3d45c53d6208 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045705 Jun 07 13:23:13.731882 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 292/599] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:13 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:13.802679 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:13.810596 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:13.812152 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:13.813289 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9ab078c0-fffd-4e53-9abf-a7c9539e5701 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1407 microversion: 2.20 time: 0.164711 Jun 07 13:23:13.813838 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 308/600] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:13 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:14.743742 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fc3136c7-48dc-4231-90a0-d0d4c79d441b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:14.744687 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fc3136c7-48dc-4231-90a0-d0d4c79d441b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:14.751160 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fc3136c7-48dc-4231-90a0-d0d4c79d441b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:14.751612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fc3136c7-48dc-4231-90a0-d0d4c79d441b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:14.752370 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fc3136c7-48dc-4231-90a0-d0d4c79d441b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:14.752805 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fc3136c7-48dc-4231-90a0-d0d4c79d441b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:14.781041 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fc3136c7-48dc-4231-90a0-d0d4c79d441b tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041294 Jun 07 13:23:14.781591 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 293/601] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:14 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:23:14.831210 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:14.831819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:14.838727 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:14.839228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:14.839995 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:14.840427 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:14.849286 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-11043fc4-6523-48b0-a0b3-1d08386531ae tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:14.849775 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-11043fc4-6523-48b0-a0b3-1d08386531ae tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:14.856619 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11043fc4-6523-48b0-a0b3-1d08386531ae tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:14.857068 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11043fc4-6523-48b0-a0b3-1d08386531ae tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:14.857814 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11043fc4-6523-48b0-a0b3-1d08386531ae tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:14.858244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11043fc4-6523-48b0-a0b3-1d08386531ae tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:14.883142 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-11043fc4-6523-48b0-a0b3-1d08386531ae tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Going to try to terminate instance {{(pid=117842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:23:14.957336 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-11043fc4-6523-48b0-a0b3-1d08386531ae tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 204 len: 0 microversion: 2.1 time: 0.111464 Jun 07 13:23:14.958204 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 294/602] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:23:14 2022] DELETE /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:23:14.966949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fa2bf4ec-a1d1-4ed8-b6fa-b564238a7bed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:14.967788 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fa2bf4ec-a1d1-4ed8-b6fa-b564238a7bed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:14.970274 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:14.973442 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa2bf4ec-a1d1-4ed8-b6fa-b564238a7bed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:14.973890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa2bf4ec-a1d1-4ed8-b6fa-b564238a7bed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:14.974653 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa2bf4ec-a1d1-4ed8-b6fa-b564238a7bed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:14.975118 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa2bf4ec-a1d1-4ed8-b6fa-b564238a7bed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:14.978732 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:14.980512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:14.981619 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7e3564a1-851b-4462-afa5-0c23263be9b9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1407 microversion: 2.20 time: 0.154201 Jun 07 13:23:14.982172 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 309/603] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:14 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:15.102634 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fa2bf4ec-a1d1-4ed8-b6fa-b564238a7bed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:15.110268 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fa2bf4ec-a1d1-4ed8-b6fa-b564238a7bed tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1688 microversion: 2.1 time: 0.147306 Jun 07 13:23:15.110822 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 295/604] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:14 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:15.817781 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-063d0d2c-0725-46fd-843f-26b5b3a0b1d6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:15.818280 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-063d0d2c-0725-46fd-843f-26b5b3a0b1d6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:15.824909 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-063d0d2c-0725-46fd-843f-26b5b3a0b1d6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:15.825360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-063d0d2c-0725-46fd-843f-26b5b3a0b1d6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:15.826120 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-063d0d2c-0725-46fd-843f-26b5b3a0b1d6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:15.826557 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-063d0d2c-0725-46fd-843f-26b5b3a0b1d6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:15.849197 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-063d0d2c-0725-46fd-843f-26b5b3a0b1d6 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/ips" status: 200 len: 150 microversion: 2.1 time: 0.088612 Jun 07 13:23:15.849801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 310/605] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:23:15 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/ips => generated 150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:15.999458 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:16.000070 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:16.006509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.007004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.008366 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.008749 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.028423 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:16.128344 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fd92ff82-39bd-4fb9-9a01-f60b3ade0ac4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:16.129096 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fd92ff82-39bd-4fb9-9a01-f60b3ade0ac4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:16.135845 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd92ff82-39bd-4fb9-9a01-f60b3ade0ac4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.136380 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd92ff82-39bd-4fb9-9a01-f60b3ade0ac4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.137352 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd92ff82-39bd-4fb9-9a01-f60b3ade0ac4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.137854 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd92ff82-39bd-4fb9-9a01-f60b3ade0ac4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.159947 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:16.168203 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:16.170069 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:16.171554 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-58bf6ebc-9055-4578-91ab-7acd0283382d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1599 microversion: 2.20 time: 0.175859 Jun 07 13:23:16.172215 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 296/606] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:23:15 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:23:16.189396 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2ca1d261-d34a-4b9e-9ce1-fef0a2d7e743 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:16.190363 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2ca1d261-d34a-4b9e-9ce1-fef0a2d7e743 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:16.197665 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ca1d261-d34a-4b9e-9ce1-fef0a2d7e743 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.198204 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ca1d261-d34a-4b9e-9ce1-fef0a2d7e743 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.199081 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ca1d261-d34a-4b9e-9ce1-fef0a2d7e743 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.199578 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ca1d261-d34a-4b9e-9ce1-fef0a2d7e743 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.304212 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2ca1d261-d34a-4b9e-9ce1-fef0a2d7e743 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118757 Jun 07 13:23:16.305418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 297/607] 10.222.0.61 () {60 vars in 1315 bytes} [Tue Jun 7 13:23:16 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:23:16.310993 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fd92ff82-39bd-4fb9-9a01-f60b3ade0ac4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:16.316960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fd92ff82-39bd-4fb9-9a01-f60b3ade0ac4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1688 microversion: 2.1 time: 0.192782 Jun 07 13:23:16.317528 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 311/608] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:16 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:17.159862 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1cef09f3-89e8-4fc5-bac4-e2d081102c0e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1397b16c-d897-4f61-bd98-68bcf6aa7a30"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:17.161239 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1cef09f3-89e8-4fc5-bac4-e2d081102c0e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:17.168315 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1cef09f3-89e8-4fc5-bac4-e2d081102c0e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.168764 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1cef09f3-89e8-4fc5-bac4-e2d081102c0e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.169530 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1cef09f3-89e8-4fc5-bac4-e2d081102c0e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.169962 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1cef09f3-89e8-4fc5-bac4-e2d081102c0e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.191746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-dd1bb456-9d73-4c75-9d2d-881f8f2f75d8 req-4e654410-b371-4f8b-a70e-6a4918b7bbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c812d20c-e7fd-49b1-9813-91433ee35219", "tag": "1df72142-8d3b-4965-899a-3271031c03d3"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:17.199907 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-dd1bb456-9d73-4c75-9d2d-881f8f2f75d8 req-4e654410-b371-4f8b-a70e-6a4918b7bbe9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.200358 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-dd1bb456-9d73-4c75-9d2d-881f8f2f75d8 req-4e654410-b371-4f8b-a70e-6a4918b7bbe9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.214250 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-dd1bb456-9d73-4c75-9d2d-881f8f2f75d8 req-4e654410-b371-4f8b-a70e-6a4918b7bbe9 service nova] Creating event network-changed:1df72142-8d3b-4965-899a-3271031c03d3 for instance c812d20c-e7fd-49b1-9813-91433ee35219 on hv-cinder-84460 Jun 07 13:23:17.219373 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-dd1bb456-9d73-4c75-9d2d-881f8f2f75d8 req-4e654410-b371-4f8b-a70e-6a4918b7bbe9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031113 Jun 07 13:23:17.219980 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 312/609] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:17.335213 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-183891f0-5745-488b-9d70-f8a4ec0bdfb5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:17.336400 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-183891f0-5745-488b-9d70-f8a4ec0bdfb5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:17.342707 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-183891f0-5745-488b-9d70-f8a4ec0bdfb5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.343195 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-183891f0-5745-488b-9d70-f8a4ec0bdfb5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.343960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-183891f0-5745-488b-9d70-f8a4ec0bdfb5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.344399 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-183891f0-5745-488b-9d70-f8a4ec0bdfb5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.348396 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:17.488338 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-183891f0-5745-488b-9d70-f8a4ec0bdfb5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:17.496065 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-183891f0-5745-488b-9d70-f8a4ec0bdfb5 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1688 microversion: 2.1 time: 0.165132 Jun 07 13:23:17.496656 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 313/610] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:17 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:18.513828 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1ec1f01d-e3dd-4558-89d3-a7eef52c04e2 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:18.514546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1ec1f01d-e3dd-4558-89d3-a7eef52c04e2 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:18.521445 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ec1f01d-e3dd-4558-89d3-a7eef52c04e2 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:18.521901 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ec1f01d-e3dd-4558-89d3-a7eef52c04e2 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:18.522672 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ec1f01d-e3dd-4558-89d3-a7eef52c04e2 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:18.523236 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ec1f01d-e3dd-4558-89d3-a7eef52c04e2 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:18.648862 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1ec1f01d-e3dd-4558-89d3-a7eef52c04e2 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:18.656553 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1ec1f01d-e3dd-4558-89d3-a7eef52c04e2 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1688 microversion: 2.1 time: 0.146578 Jun 07 13:23:18.657124 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 314/611] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:18 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1688 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:19.673379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9488feb1-fc54-425e-a238-6d56ce922459 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:19.673996 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9488feb1-fc54-425e-a238-6d56ce922459 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:19.679954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9488feb1-fc54-425e-a238-6d56ce922459 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:19.680403 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9488feb1-fc54-425e-a238-6d56ce922459 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:19.681151 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9488feb1-fc54-425e-a238-6d56ce922459 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:19.681581 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9488feb1-fc54-425e-a238-6d56ce922459 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:19.817153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9488feb1-fc54-425e-a238-6d56ce922459 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:19.825589 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9488feb1-fc54-425e-a238-6d56ce922459 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1688 microversion: 2.1 time: 0.156047 Jun 07 13:23:19.826156 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 315/612] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:19 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:19.868452 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1cef09f3-89e8-4fc5-bac4-e2d081102c0e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.712966 Jun 07 13:23:19.869149 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 298/613] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:23:17 2022] POST /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments => generated 194 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:20.842568 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6f5f9ce1-14bc-417a-accb-b4f5cbfdcff8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:20.843195 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6f5f9ce1-14bc-417a-accb-b4f5cbfdcff8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:20.849387 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f5f9ce1-14bc-417a-accb-b4f5cbfdcff8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:20.849834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f5f9ce1-14bc-417a-accb-b4f5cbfdcff8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:20.850588 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f5f9ce1-14bc-417a-accb-b4f5cbfdcff8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:20.851051 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6f5f9ce1-14bc-417a-accb-b4f5cbfdcff8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:20.915345 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6f5f9ce1-14bc-417a-accb-b4f5cbfdcff8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:20.924105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6f5f9ce1-14bc-417a-accb-b4f5cbfdcff8 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 200 len: 1620 microversion: 2.1 time: 0.085261 Jun 07 13:23:20.924977 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 316/614] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:20 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 1620 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:21.033990 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-164a6f6d-2781-4fe2-b06b-2bc167dc395a req-2de8b4df-1532-4202-80ae-73fd5132b23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb5d9cf-92eb-45b1-b8b5-73af66067558", "name": "network-vif-deleted", "tag": "541e0200-55c0-4b40-a06e-d6fcf5d21cf5"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:21.044081 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-164a6f6d-2781-4fe2-b06b-2bc167dc395a req-2de8b4df-1532-4202-80ae-73fd5132b23f service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:21.044773 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-164a6f6d-2781-4fe2-b06b-2bc167dc395a req-2de8b4df-1532-4202-80ae-73fd5132b23f service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:21.057340 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-164a6f6d-2781-4fe2-b06b-2bc167dc395a req-2de8b4df-1532-4202-80ae-73fd5132b23f service nova] Creating event network-vif-deleted:541e0200-55c0-4b40-a06e-d6fcf5d21cf5 for instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 on hv-cinder-84460 Jun 07 13:23:21.062041 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-164a6f6d-2781-4fe2-b06b-2bc167dc395a req-2de8b4df-1532-4202-80ae-73fd5132b23f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113228 Jun 07 13:23:21.063238 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 299/615] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:21.941771 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:21.942331 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 3fb5d9cf-92eb-45b1-b8b5-73af66067558] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:21.948283 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:21.948734 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:21.949497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:21.949929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:21.963149 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] HTTP exception thrown: Instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 could not be found. Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Request method failure captured: Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 HTTP/1.1 Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1ARh_w5x3eyvpxmWFo09bX4TSX7lLT_QFdDuGbNXfNSwNB7Ug2bSzEg0_5-gIjvqMn5A1vi5Xw8j5s7JEtRkwMs4XaMuLBw0pPzIbLaotV0Qulk_SIiHBUsGrk51-OZ_-x0oYSlJal38kNshd-TA2kCT8m4QD4_whvIVBFX_68qnus Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:23:21.964793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: dcf5286e9ca14f56905e6e247e411896 Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 could not be found. Jun 07 13:23:21.966072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '3fb5d9cf-92eb-45b1-b8b5-73af66067558'} Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 could not be found. Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:23:21.966796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 could not be found. Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 could not be found. Jun 07 13:23:21.968021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.969095 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Returning 404 to user: Instance 3fb5d9cf-92eb-45b1-b8b5-73af66067558 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:23:21.969095 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a75d62c6-b28f-4bc6-8d22-f181a51b946a tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558" status: 404 len: 111 microversion: 2.1 time: 0.028406 Jun 07 13:23:21.969095 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 317/616] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:21 2022] GET /compute/v2.1/servers/3fb5d9cf-92eb-45b1-b8b5-73af66067558 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:23:21.975853 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6b443c50-df5f-4f10-98fc-2d8e842a058f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '.version_select at 0x7f46a369b1f0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:21.995945 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6b443c50-df5f-4f10-98fc-2d8e842a058f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625845876" status: 202 len: 0 microversion: 2.1 time: 0.024593 Jun 07 13:23:21.999852 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 300/617] 10.222.0.61 () {58 vars in 1217 bytes} [Tue Jun 7 13:23:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625845876 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:23:24.853617 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4f6e7b5a-94fc-4c5f-81a0-6c2841ce6da4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:24.854121 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4f6e7b5a-94fc-4c5f-81a0-6c2841ce6da4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:24.860530 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4f6e7b5a-94fc-4c5f-81a0-6c2841ce6da4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:24.860990 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4f6e7b5a-94fc-4c5f-81a0-6c2841ce6da4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:24.861757 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4f6e7b5a-94fc-4c5f-81a0-6c2841ce6da4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:24.862199 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4f6e7b5a-94fc-4c5f-81a0-6c2841ce6da4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:24.886581 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4f6e7b5a-94fc-4c5f-81a0-6c2841ce6da4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:23:24.959803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4f6e7b5a-94fc-4c5f-81a0-6c2841ce6da4 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 204 len: 0 microversion: 2.1 time: 0.109725 Jun 07 13:23:24.960414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 318/618] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:23:24 2022] DELETE /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:23:24.969811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d93dd140-7438-4f6d-9dd7-6332d46c17e1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:24.970545 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d93dd140-7438-4f6d-9dd7-6332d46c17e1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:24.976774 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d93dd140-7438-4f6d-9dd7-6332d46c17e1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:24.977228 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d93dd140-7438-4f6d-9dd7-6332d46c17e1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:24.977992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d93dd140-7438-4f6d-9dd7-6332d46c17e1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:24.978430 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d93dd140-7438-4f6d-9dd7-6332d46c17e1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:25.106557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d93dd140-7438-4f6d-9dd7-6332d46c17e1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:25.114141 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d93dd140-7438-4f6d-9dd7-6332d46c17e1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1507 microversion: 2.1 time: 0.148890 Jun 07 13:23:25.114707 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 301/619] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:24 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:26.131520 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8aec0492-7cf4-4acf-83da-99e53baae1d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:26.132219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8aec0492-7cf4-4acf-83da-99e53baae1d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:26.134812 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:26.140440 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8aec0492-7cf4-4acf-83da-99e53baae1d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:26.140834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8aec0492-7cf4-4acf-83da-99e53baae1d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:26.141596 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8aec0492-7cf4-4acf-83da-99e53baae1d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:26.142040 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8aec0492-7cf4-4acf-83da-99e53baae1d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:26.470323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8aec0492-7cf4-4acf-83da-99e53baae1d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:26.478355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8aec0492-7cf4-4acf-83da-99e53baae1d6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1507 microversion: 2.1 time: 0.351090 Jun 07 13:23:26.478942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 319/620] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:26 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:27.495363 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-355a451c-2ed1-4461-b1a2-f356301601c1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:27.495914 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-355a451c-2ed1-4461-b1a2-f356301601c1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:27.498418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:27.503899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-355a451c-2ed1-4461-b1a2-f356301601c1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:27.504363 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-355a451c-2ed1-4461-b1a2-f356301601c1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:27.505132 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-355a451c-2ed1-4461-b1a2-f356301601c1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:27.505574 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-355a451c-2ed1-4461-b1a2-f356301601c1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:27.631529 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-355a451c-2ed1-4461-b1a2-f356301601c1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:27.638907 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-355a451c-2ed1-4461-b1a2-f356301601c1 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1507 microversion: 2.1 time: 0.147448 Jun 07 13:23:27.639483 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 302/621] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:27 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:28.655415 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4cfa98b5-1049-4175-a838-416dfec970f6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:28.655954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4cfa98b5-1049-4175-a838-416dfec970f6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:28.662156 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4cfa98b5-1049-4175-a838-416dfec970f6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:28.662607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4cfa98b5-1049-4175-a838-416dfec970f6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:28.663401 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4cfa98b5-1049-4175-a838-416dfec970f6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:28.664343 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4cfa98b5-1049-4175-a838-416dfec970f6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:28.797420 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4cfa98b5-1049-4175-a838-416dfec970f6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:28.805486 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4cfa98b5-1049-4175-a838-416dfec970f6 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 200 len: 1507 microversion: 2.1 time: 0.154129 Jun 07 13:23:28.806063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 320/622] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:28 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:29.216928 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-03536e08-7834-4ac5-a752-e94e4c901cc1 req-92091b2e-a089-46c8-a029-1a693efb7f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5b3667-5810-4568-976f-ca312dc065f4", "name": "network-vif-deleted", "tag": "853e6961-92a5-492c-a8b3-2379de8141ed"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:29.228889 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-03536e08-7834-4ac5-a752-e94e4c901cc1 req-92091b2e-a089-46c8-a029-1a693efb7f3e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.229348 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-03536e08-7834-4ac5-a752-e94e4c901cc1 req-92091b2e-a089-46c8-a029-1a693efb7f3e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.244783 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-03536e08-7834-4ac5-a752-e94e4c901cc1 req-92091b2e-a089-46c8-a029-1a693efb7f3e service nova] Creating event network-vif-deleted:853e6961-92a5-492c-a8b3-2379de8141ed for instance ba5b3667-5810-4568-976f-ca312dc065f4 on hv-cinder-84460 Jun 07 13:23:29.249932 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-03536e08-7834-4ac5-a752-e94e4c901cc1 req-92091b2e-a089-46c8-a029-1a693efb7f3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036833 Jun 07 13:23:29.250529 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 303/623] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:29.468969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1397b16c-d897-4f61-bd98-68bcf6aa7a30"}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:29.470114 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:29.476629 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.477087 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.477838 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.478266 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.560908 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Invalid volume: volume 1397b16c-d897-4f61-bd98-68bcf6aa7a30 is already attached to instances: 0ce009cf-5ec7-48ea-98dd-9488421317c2 Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: POST /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments HTTP/1.1 Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 74 Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:23:29.562635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {"volumeAttachment": {"volumeId": "1397b16c-d897-4f61-bd98-68bcf6aa7a30"}} Jun 07 13:23:29.564418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Invalid volume: volume 1397b16c-d897-4f61-bd98-68bcf6aa7a30 is already attached to instances: 0ce009cf-5ec7-48ea-98dd-9488421317c2 Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'server_id': '0ce009cf-5ec7-48ea-98dd-9488421317c2', 'body': {'volumeAttachment': {'volumeId': '1397b16c-d897-4f61-bd98-68bcf6aa7a30'}}} Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1397b16c-d897-4f61-bd98-68bcf6aa7a30 is already attached to instances: 0ce009cf-5ec7-48ea-98dd-9488421317c2 Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.565294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1397b16c-d897-4f61-bd98-68bcf6aa7a30 is already attached to instances: 0ce009cf-5ec7-48ea-98dd-9488421317c2 Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:29.566467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:29.567695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:29.567695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:23:29.567695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:23:29.567695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1397b16c-d897-4f61-bd98-68bcf6aa7a30 is already attached to instances: 0ce009cf-5ec7-48ea-98dd-9488421317c2 Jun 07 13:23:29.567695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.567695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 400 to user: Invalid volume: volume 1397b16c-d897-4f61-bd98-68bcf6aa7a30 is already attached to instances: 0ce009cf-5ec7-48ea-98dd-9488421317c2 {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:23:29.567695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8c390fde-831c-4f31-9c8a-52b210513241 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099116 Jun 07 13:23:29.567695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 321/624] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:23:29 2022] POST /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:23:29.627754 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-091f2576-36d6-4585-8e5b-785740eed26b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:29.628432 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-091f2576-36d6-4585-8e5b-785740eed26b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:29.635034 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-091f2576-36d6-4585-8e5b-785740eed26b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.635311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-091f2576-36d6-4585-8e5b-785740eed26b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.636058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-091f2576-36d6-4585-8e5b-785740eed26b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.636485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-091f2576-36d6-4585-8e5b-785740eed26b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.716993 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-091f2576-36d6-4585-8e5b-785740eed26b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lazy-loading 'services' on Instance uuid 0ce009cf-5ec7-48ea-98dd-9488421317c2 {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:23:29.790074 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-091f2576-36d6-4585-8e5b-785740eed26b tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments/1397b16c-d897-4f61-bd98-68bcf6aa7a30" status: 202 len: 0 microversion: 2.1 time: 0.165960 Jun 07 13:23:29.791294 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 304/625] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:23:29 2022] DELETE /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments/1397b16c-d897-4f61-bd98-68bcf6aa7a30 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:23:29.799093 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-bbed76e3-1a06-4bd7-8a79-c526282aa8f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:29.800157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-bbed76e3-1a06-4bd7-8a79-c526282aa8f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:29.807322 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-bbed76e3-1a06-4bd7-8a79-c526282aa8f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.807777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-bbed76e3-1a06-4bd7-8a79-c526282aa8f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.808546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-bbed76e3-1a06-4bd7-8a79-c526282aa8f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.808981 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-bbed76e3-1a06-4bd7-8a79-c526282aa8f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.824964 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:29.825660 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: ba5b3667-5810-4568-976f-ca312dc065f4] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:29.832944 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.833708 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.834534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.835156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.843062 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-bbed76e3-1a06-4bd7-8a79-c526282aa8f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047846 Jun 07 13:23:29.844081 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 322/626] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:29 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:29.849754 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] HTTP exception thrown: Instance ba5b3667-5810-4568-976f-ca312dc065f4 could not be found. Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Request method failure captured: Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 HTTP/1.1 Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARh_w5x3eyvpxmWFo09bX4TSX7lLT_QFdDuGbNXfNSwNB7Ug2bSzEg0_5-gIjvqMn5A1vi5Xw8j5s7JEtRkwMs4XaMuLBw0pPzIbLaotV0Qulk_SIiHBUsGrk51-OZ_-x0oYSlJal38kNshd-TA2kCT8m4QD4_whvIVBFX_68qnus Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:23:29.852008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: dcf5286e9ca14f56905e6e247e411896 Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance ba5b3667-5810-4568-976f-ca312dc065f4 could not be found. Jun 07 13:23:29.853532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': 'ba5b3667-5810-4568-976f-ca312dc065f4'} Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5b3667-5810-4568-976f-ca312dc065f4 could not be found. Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:23:29.854400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5b3667-5810-4568-976f-ca312dc065f4 could not be found. Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5b3667-5810-4568-976f-ca312dc065f4 could not be found. Jun 07 13:23:29.856128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:29.857384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Returning 404 to user: Instance ba5b3667-5810-4568-976f-ca312dc065f4 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:23:29.857384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cf5187e1-d5e8-4d06-a615-269cac8d8808 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4" status: 404 len: 111 microversion: 2.1 time: 0.034459 Jun 07 13:23:29.857384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 305/627] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:29 2022] GET /compute/v2.1/servers/ba5b3667-5810-4568-976f-ca312dc065f4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:23:29.862456 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f211d7a7-c091-457a-bba2-1ea4400afcac tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:29.862456 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f211d7a7-c091-457a-bba2-1ea4400afcac tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:29.868559 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f211d7a7-c091-457a-bba2-1ea4400afcac tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.869018 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f211d7a7-c091-457a-bba2-1ea4400afcac tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.869782 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f211d7a7-c091-457a-bba2-1ea4400afcac tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.870223 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f211d7a7-c091-457a-bba2-1ea4400afcac tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.896473 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f211d7a7-c091-457a-bba2-1ea4400afcac tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:23:29.969088 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f211d7a7-c091-457a-bba2-1ea4400afcac tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "DELETE /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 204 len: 0 microversion: 2.1 time: 0.110490 Jun 07 13:23:29.969585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 323/628] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:23:29 2022] DELETE /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:23:29.978053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-eb55e057-70e8-473a-997f-6e65732c709c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:29.978694 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-eb55e057-70e8-473a-997f-6e65732c709c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:29.984977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-eb55e057-70e8-473a-997f-6e65732c709c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.985427 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-eb55e057-70e8-473a-997f-6e65732c709c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.986173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-eb55e057-70e8-473a-997f-6e65732c709c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.986604 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-eb55e057-70e8-473a-997f-6e65732c709c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:30.110983 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-eb55e057-70e8-473a-997f-6e65732c709c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:30.118442 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-eb55e057-70e8-473a-997f-6e65732c709c tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.144793 Jun 07 13:23:30.119034 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 306/629] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:29 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:30.856457 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d8228d9a-c7bb-4386-aa8b-f1819f81c74d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:30.857463 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d8228d9a-c7bb-4386-aa8b-f1819f81c74d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:30.863524 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d8228d9a-c7bb-4386-aa8b-f1819f81c74d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:30.863979 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d8228d9a-c7bb-4386-aa8b-f1819f81c74d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:30.864736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d8228d9a-c7bb-4386-aa8b-f1819f81c74d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:30.865171 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d8228d9a-c7bb-4386-aa8b-f1819f81c74d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:30.893577 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d8228d9a-c7bb-4386-aa8b-f1819f81c74d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042147 Jun 07 13:23:30.894120 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 324/630] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:30 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:31.135807 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a17f68cd-8cd7-483f-8833-7d8649f8291d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:31.136369 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a17f68cd-8cd7-483f-8833-7d8649f8291d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:31.142845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a17f68cd-8cd7-483f-8833-7d8649f8291d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:31.143301 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a17f68cd-8cd7-483f-8833-7d8649f8291d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:31.144048 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a17f68cd-8cd7-483f-8833-7d8649f8291d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:31.144481 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a17f68cd-8cd7-483f-8833-7d8649f8291d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:31.273826 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a17f68cd-8cd7-483f-8833-7d8649f8291d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:31.281226 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a17f68cd-8cd7-483f-8833-7d8649f8291d tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.149341 Jun 07 13:23:31.281790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 307/631] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:31 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:31.905498 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d505710d-cc8b-4379-a5ca-78395a4c32fd tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:31.906417 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d505710d-cc8b-4379-a5ca-78395a4c32fd tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:31.912624 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d505710d-cc8b-4379-a5ca-78395a4c32fd tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:31.913079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d505710d-cc8b-4379-a5ca-78395a4c32fd tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:31.913848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d505710d-cc8b-4379-a5ca-78395a4c32fd tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:31.914288 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d505710d-cc8b-4379-a5ca-78395a4c32fd tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:31.942515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d505710d-cc8b-4379-a5ca-78395a4c32fd tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041017 Jun 07 13:23:31.943099 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 325/632] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:31 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:32.299045 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d82f8f78-7c62-4fc7-a70e-f7adb57d2156 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:32.299653 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d82f8f78-7c62-4fc7-a70e-f7adb57d2156 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:32.306692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d82f8f78-7c62-4fc7-a70e-f7adb57d2156 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:32.307158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d82f8f78-7c62-4fc7-a70e-f7adb57d2156 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:32.308202 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d82f8f78-7c62-4fc7-a70e-f7adb57d2156 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:32.308644 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d82f8f78-7c62-4fc7-a70e-f7adb57d2156 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:32.433696 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d82f8f78-7c62-4fc7-a70e-f7adb57d2156 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:32.441170 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d82f8f78-7c62-4fc7-a70e-f7adb57d2156 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.146269 Jun 07 13:23:32.441730 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 308/633] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:32 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:32.954746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6e78e47f-3c6b-46da-8edd-095366250cf4 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:32.955748 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6e78e47f-3c6b-46da-8edd-095366250cf4 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:32.962241 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e78e47f-3c6b-46da-8edd-095366250cf4 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:32.962693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e78e47f-3c6b-46da-8edd-095366250cf4 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:32.963483 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e78e47f-3c6b-46da-8edd-095366250cf4 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:32.963920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e78e47f-3c6b-46da-8edd-095366250cf4 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:32.992319 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6e78e47f-3c6b-46da-8edd-095366250cf4 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041548 Jun 07 13:23:32.992862 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 326/634] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:32 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:33.457487 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6254a2db-e430-45df-b762-aa69b1cfdb04 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:33.458098 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6254a2db-e430-45df-b762-aa69b1cfdb04 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:33.464999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6254a2db-e430-45df-b762-aa69b1cfdb04 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:33.465446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6254a2db-e430-45df-b762-aa69b1cfdb04 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:33.466203 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6254a2db-e430-45df-b762-aa69b1cfdb04 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:33.466634 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6254a2db-e430-45df-b762-aa69b1cfdb04 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:33.589855 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6254a2db-e430-45df-b762-aa69b1cfdb04 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:33.597233 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6254a2db-e430-45df-b762-aa69b1cfdb04 tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1521 microversion: 2.1 time: 0.143606 Jun 07 13:23:33.597790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 309/635] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:33 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:34.003809 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-926de115-cbae-49f5-8989-19fa5ee9ac9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:34.004773 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-926de115-cbae-49f5-8989-19fa5ee9ac9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:34.010917 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-926de115-cbae-49f5-8989-19fa5ee9ac9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:34.011369 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-926de115-cbae-49f5-8989-19fa5ee9ac9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:34.012130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-926de115-cbae-49f5-8989-19fa5ee9ac9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:34.012567 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-926de115-cbae-49f5-8989-19fa5ee9ac9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:34.016219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:34.043094 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-926de115-cbae-49f5-8989-19fa5ee9ac9d tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Jun 07 13:23:34.043648 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 327/636] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:33 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:34.622513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0888e262-f4d5-48a4-a94d-7cd7c2f7ab0f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:34.623165 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0888e262-f4d5-48a4-a94d-7cd7c2f7ab0f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:34.630304 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0888e262-f4d5-48a4-a94d-7cd7c2f7ab0f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:34.630941 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0888e262-f4d5-48a4-a94d-7cd7c2f7ab0f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:34.631901 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0888e262-f4d5-48a4-a94d-7cd7c2f7ab0f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:34.632656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0888e262-f4d5-48a4-a94d-7cd7c2f7ab0f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:34.667264 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-1ad880bf-40b7-475a-8e5f-e40956c4662f req-28243082-606c-42d9-8923-aeaae9d6fb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bca688-1384-4f4d-a129-4129e290831c", "name": "network-vif-deleted", "tag": "9fbff3a7-3340-450f-bac9-a55605b332c7"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:34.677391 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-1ad880bf-40b7-475a-8e5f-e40956c4662f req-28243082-606c-42d9-8923-aeaae9d6fb56 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:34.677999 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-1ad880bf-40b7-475a-8e5f-e40956c4662f req-28243082-606c-42d9-8923-aeaae9d6fb56 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:34.691191 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-1ad880bf-40b7-475a-8e5f-e40956c4662f req-28243082-606c-42d9-8923-aeaae9d6fb56 service nova] Creating event network-vif-deleted:9fbff3a7-3340-450f-bac9-a55605b332c7 for instance 23bca688-1384-4f4d-a129-4129e290831c on hv-cinder-84460 Jun 07 13:23:34.698326 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-1ad880bf-40b7-475a-8e5f-e40956c4662f req-28243082-606c-42d9-8923-aeaae9d6fb56 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034949 Jun 07 13:23:34.699363 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 328/637] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:34.703514 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0888e262-f4d5-48a4-a94d-7cd7c2f7ab0f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf5286e9ca14f56905e6e247e411896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c615cd1e80a42e0ac2aff126cbb1455', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:34.712065 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0888e262-f4d5-48a4-a94d-7cd7c2f7ab0f tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 200 len: 1479 microversion: 2.1 time: 0.098167 Jun 07 13:23:34.712651 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 310/638] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:34 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 1479 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:35.056056 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5435f545-8be7-4a67-aef1-076c5e503831 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:35.057098 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5435f545-8be7-4a67-aef1-076c5e503831 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:35.063678 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5435f545-8be7-4a67-aef1-076c5e503831 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.064139 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5435f545-8be7-4a67-aef1-076c5e503831 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.064915 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5435f545-8be7-4a67-aef1-076c5e503831 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.065356 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5435f545-8be7-4a67-aef1-076c5e503831 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.094952 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5435f545-8be7-4a67-aef1-076c5e503831 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043646 Jun 07 13:23:35.095519 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 329/639] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:35 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:23:35.154441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-70ef9670-caf7-49bc-864f-6c5aa837bd26 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:35.154967 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-70ef9670-caf7-49bc-864f-6c5aa837bd26 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:35.161094 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-70ef9670-caf7-49bc-864f-6c5aa837bd26 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.161545 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-70ef9670-caf7-49bc-864f-6c5aa837bd26 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.162302 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-70ef9670-caf7-49bc-864f-6c5aa837bd26 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.162734 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-70ef9670-caf7-49bc-864f-6c5aa837bd26 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.187759 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-70ef9670-caf7-49bc-864f-6c5aa837bd26 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Going to try to terminate instance {{(pid=117842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:23:35.261851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-70ef9670-caf7-49bc-864f-6c5aa837bd26 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 204 len: 0 microversion: 2.1 time: 0.111006 Jun 07 13:23:35.262452 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 311/640] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:23:35 2022] DELETE /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:23:35.271302 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-74a68c25-5fcc-47c7-a876-9def37bbc6c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:35.271919 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-74a68c25-5fcc-47c7-a876-9def37bbc6c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:35.277854 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-74a68c25-5fcc-47c7-a876-9def37bbc6c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.278307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-74a68c25-5fcc-47c7-a876-9def37bbc6c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.279096 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-74a68c25-5fcc-47c7-a876-9def37bbc6c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.279535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-74a68c25-5fcc-47c7-a876-9def37bbc6c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.406599 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-74a68c25-5fcc-47c7-a876-9def37bbc6c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:35.414205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-74a68c25-5fcc-47c7-a876-9def37bbc6c5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1682 microversion: 2.1 time: 0.146788 Jun 07 13:23:35.414842 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 330/641] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:35 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:35.729668 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:35.730368 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] [instance: 23bca688-1384-4f4d-a129-4129e290831c] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:35.737090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.737548 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.738310 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.738748 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.752794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] HTTP exception thrown: Instance 23bca688-1384-4f4d-a129-4129e290831c could not be found. Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Request method failure captured: Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c HTTP/1.1 Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARh_w5x3eyvpxmWFo09bX4TSX7lLT_QFdDuGbNXfNSwNB7Ug2bSzEg0_5-gIjvqMn5A1vi5Xw8j5s7JEtRkwMs4XaMuLBw0pPzIbLaotV0Qulk_SIiHBUsGrk51-OZ_-x0oYSlJal38kNshd-TA2kCT8m4QD4_whvIVBFX_68qnus Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:23:35.754451 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c615cd1e80a42e0ac2aff126cbb1455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 7c615cd1e80a42e0ac2aff126cbb1455 Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1835430678 Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: dcf5286e9ca14f56905e6e247e411896 Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1835430678-project Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 23bca688-1384-4f4d-a129-4129e290831c could not be found. Jun 07 13:23:35.755949 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '23bca688-1384-4f4d-a129-4129e290831c'} Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23bca688-1384-4f4d-a129-4129e290831c could not be found. Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:23:35.756756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23bca688-1384-4f4d-a129-4129e290831c could not be found. Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23bca688-1384-4f4d-a129-4129e290831c could not be found. Jun 07 13:23:35.758016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:23:35.759900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] Returning 404 to user: Instance 23bca688-1384-4f4d-a129-4129e290831c could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:23:35.759900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a6b46425-75ef-4ab3-9c24-7ff34b28d55e tempest-ServerRescueNegativeTestJSON-1835430678 tempest-ServerRescueNegativeTestJSON-1835430678-project] 10.222.0.61 "GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c" status: 404 len: 111 microversion: 2.1 time: 0.030507 Jun 07 13:23:35.759900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 312/642] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:35 2022] GET /compute/v2.1/servers/23bca688-1384-4f4d-a129-4129e290831c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:23:36.327839 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-91dfc090-41f5-44e0-bd90-1a8b7be04d72 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:36.328422 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-91dfc090-41f5-44e0-bd90-1a8b7be04d72 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:36.334663 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-91dfc090-41f5-44e0-bd90-1a8b7be04d72 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:36.335161 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-91dfc090-41f5-44e0-bd90-1a8b7be04d72 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:36.335937 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-91dfc090-41f5-44e0-bd90-1a8b7be04d72 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:36.336370 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-91dfc090-41f5-44e0-bd90-1a8b7be04d72 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:36.363144 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-91dfc090-41f5-44e0-bd90-1a8b7be04d72 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:23:36.431721 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c41dc092-bd2f-4a6b-b5ba-afc592a3c6ec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:36.432593 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c41dc092-bd2f-4a6b-b5ba-afc592a3c6ec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:36.439461 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c41dc092-bd2f-4a6b-b5ba-afc592a3c6ec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:36.439915 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c41dc092-bd2f-4a6b-b5ba-afc592a3c6ec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:36.441309 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c41dc092-bd2f-4a6b-b5ba-afc592a3c6ec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:36.441746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c41dc092-bd2f-4a6b-b5ba-afc592a3c6ec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:36.451421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-91dfc090-41f5-44e0-bd90-1a8b7be04d72 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 204 len: 0 microversion: 2.1 time: 0.127229 Jun 07 13:23:36.455083 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 331/643] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:23:36 2022] DELETE /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:23:36.460875 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7680dd27-91b9-4e4b-82d6-682e25077b0c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:36.462439 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7680dd27-91b9-4e4b-82d6-682e25077b0c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:36.463400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:36.469467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7680dd27-91b9-4e4b-82d6-682e25077b0c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:36.469918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7680dd27-91b9-4e4b-82d6-682e25077b0c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:36.470692 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7680dd27-91b9-4e4b-82d6-682e25077b0c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:36.471163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7680dd27-91b9-4e4b-82d6-682e25077b0c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:36.646555 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c41dc092-bd2f-4a6b-b5ba-afc592a3c6ec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:36.651067 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7680dd27-91b9-4e4b-82d6-682e25077b0c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:36.655418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c41dc092-bd2f-4a6b-b5ba-afc592a3c6ec tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1682 microversion: 2.1 time: 0.227805 Jun 07 13:23:36.655990 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 313/644] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:36 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:36.660195 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7680dd27-91b9-4e4b-82d6-682e25077b0c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1577 microversion: 2.1 time: 0.203211 Jun 07 13:23:36.660908 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 332/645] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:36 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:37.673781 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7456ce7c-a4c0-4ffb-835c-39d86f11cf4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:37.675077 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-7456ce7c-a4c0-4ffb-835c-39d86f11cf4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:37.678395 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c265c765-871c-4da5-9f2b-51e6f8122013 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:37.679308 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c265c765-871c-4da5-9f2b-51e6f8122013 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:37.682974 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7456ce7c-a4c0-4ffb-835c-39d86f11cf4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:37.683628 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7456ce7c-a4c0-4ffb-835c-39d86f11cf4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:37.684561 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7456ce7c-a4c0-4ffb-835c-39d86f11cf4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:37.685148 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7456ce7c-a4c0-4ffb-835c-39d86f11cf4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:37.686239 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c265c765-871c-4da5-9f2b-51e6f8122013 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:37.686761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c265c765-871c-4da5-9f2b-51e6f8122013 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:37.687904 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c265c765-871c-4da5-9f2b-51e6f8122013 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:37.688588 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c265c765-871c-4da5-9f2b-51e6f8122013 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:37.900582 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7456ce7c-a4c0-4ffb-835c-39d86f11cf4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:37.910805 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7456ce7c-a4c0-4ffb-835c-39d86f11cf4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1682 microversion: 2.1 time: 0.240979 Jun 07 13:23:37.912411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 314/646] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:37 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:37.919848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c265c765-871c-4da5-9f2b-51e6f8122013 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:37.927655 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c265c765-871c-4da5-9f2b-51e6f8122013 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1577 microversion: 2.1 time: 0.253924 Jun 07 13:23:37.928967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 333/647] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:37 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1577 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:38.930776 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-25ee4131-14fd-471a-bfd1-d56a2ac05b7e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:38.931689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-25ee4131-14fd-471a-bfd1-d56a2ac05b7e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:38.938618 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-25ee4131-14fd-471a-bfd1-d56a2ac05b7e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:38.940280 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-25ee4131-14fd-471a-bfd1-d56a2ac05b7e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:38.940280 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-25ee4131-14fd-471a-bfd1-d56a2ac05b7e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:38.940695 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-25ee4131-14fd-471a-bfd1-d56a2ac05b7e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:38.952709 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-85f3845a-e46e-4fae-8de6-217ba469fa68 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:38.954093 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-85f3845a-e46e-4fae-8de6-217ba469fa68 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:38.961458 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-85f3845a-e46e-4fae-8de6-217ba469fa68 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:38.962331 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-85f3845a-e46e-4fae-8de6-217ba469fa68 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:38.964296 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-85f3845a-e46e-4fae-8de6-217ba469fa68 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:38.965012 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-85f3845a-e46e-4fae-8de6-217ba469fa68 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:39.206048 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-25ee4131-14fd-471a-bfd1-d56a2ac05b7e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:39.214314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-25ee4131-14fd-471a-bfd1-d56a2ac05b7e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1682 microversion: 2.1 time: 0.289082 Jun 07 13:23:39.215225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 315/648] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:38 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1682 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:39.222889 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-85f3845a-e46e-4fae-8de6-217ba469fa68 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:39.231624 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-85f3845a-e46e-4fae-8de6-217ba469fa68 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1577 microversion: 2.1 time: 0.289646 Jun 07 13:23:39.232575 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 334/649] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:38 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1577 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:40.232741 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b8e4c447-4751-4886-97e2-e88774cc951f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:40.233361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b8e4c447-4751-4886-97e2-e88774cc951f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:40.239881 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8e4c447-4751-4886-97e2-e88774cc951f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.240520 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8e4c447-4751-4886-97e2-e88774cc951f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:40.241098 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8e4c447-4751-4886-97e2-e88774cc951f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.241590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8e4c447-4751-4886-97e2-e88774cc951f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:40.251145 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-eb7a2845-f8e5-4ef7-b2f2-32b03934d7bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:40.252004 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-eb7a2845-f8e5-4ef7-b2f2-32b03934d7bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:40.261092 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eb7a2845-f8e5-4ef7-b2f2-32b03934d7bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.261592 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eb7a2845-f8e5-4ef7-b2f2-32b03934d7bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:40.262447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eb7a2845-f8e5-4ef7-b2f2-32b03934d7bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.267018 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eb7a2845-f8e5-4ef7-b2f2-32b03934d7bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:40.339728 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b8e4c447-4751-4886-97e2-e88774cc951f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:40.348899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b8e4c447-4751-4886-97e2-e88774cc951f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1614 microversion: 2.1 time: 0.120223 Jun 07 13:23:40.349477 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 316/650] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:40 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:40.478615 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-eb7a2845-f8e5-4ef7-b2f2-32b03934d7bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:40.487051 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-eb7a2845-f8e5-4ef7-b2f2-32b03934d7bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1577 microversion: 2.1 time: 0.241370 Jun 07 13:23:40.487898 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 335/651] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:40 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:40.858389 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-5226a65c-2abd-4453-8a74-18a5d632a7af req-4e6a008f-62b9-408b-9e05-226fd1c4889e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce009cf-5ec7-48ea-98dd-9488421317c2", "name": "network-vif-deleted", "tag": "5b2360ca-1e30-48e4-8e27-cdc322c1bc95"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:40.871958 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-5226a65c-2abd-4453-8a74-18a5d632a7af req-4e6a008f-62b9-408b-9e05-226fd1c4889e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.873201 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-5226a65c-2abd-4453-8a74-18a5d632a7af req-4e6a008f-62b9-408b-9e05-226fd1c4889e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:40.900907 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-5226a65c-2abd-4453-8a74-18a5d632a7af req-4e6a008f-62b9-408b-9e05-226fd1c4889e service nova] Creating event network-vif-deleted:5b2360ca-1e30-48e4-8e27-cdc322c1bc95 for instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 on hv-cinder-84460 Jun 07 13:23:40.909921 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-5226a65c-2abd-4453-8a74-18a5d632a7af req-4e6a008f-62b9-408b-9e05-226fd1c4889e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056452 Jun 07 13:23:40.910766 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 317/652] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:41.366747 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:41.367430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:41.375180 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:41.376002 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:41.377327 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:41.378028 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:41.426721 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:41.427565 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:41.428269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lazy-loading 'fault' on Instance uuid 0ce009cf-5ec7-48ea-98dd-9488421317c2 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:23:41.484957 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:41.495659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9a0162d1-5f84-4f23-a35c-bbc779b4f661 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 200 len: 1331 microversion: 2.1 time: 0.131882 Jun 07 13:23:41.506218 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a6583108-dc35-4982-a3ec-5d01e6e368c7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:41.509979 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a6583108-dc35-4982-a3ec-5d01e6e368c7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:41.513780 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 336/653] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:41 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 1331 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:41.531120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6583108-dc35-4982-a3ec-5d01e6e368c7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:41.535531 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6583108-dc35-4982-a3ec-5d01e6e368c7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:41.536757 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6583108-dc35-4982-a3ec-5d01e6e368c7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:41.538261 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6583108-dc35-4982-a3ec-5d01e6e368c7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:41.653431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a6583108-dc35-4982-a3ec-5d01e6e368c7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:41.661722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a6583108-dc35-4982-a3ec-5d01e6e368c7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 200 len: 1225 microversion: 2.1 time: 0.160471 Jun 07 13:23:41.662101 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 318/654] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:41 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 1225 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:42.512574 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:42.513296 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:42.519930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:42.520414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:42.521270 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:42.521781 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:42.540746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 HTTP/1.1 Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:23:42.542630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:23:42.544163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '0ce009cf-5ec7-48ea-98dd-9488421317c2'} Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:23:42.545049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:23:42.546471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.547766 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:23:42.547766 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-46b05f96-25c2-4fad-8c81-d2c5e6187716 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 404 len: 111 microversion: 2.1 time: 0.037301 Jun 07 13:23:42.548081 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 337/655] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:42 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:23:42.556428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-70450d96-3a6e-420b-b901-e7748bd0367c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '.version_select at 0x7f46a35d6f70>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:42.575988 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-70450d96-3a6e-420b-b901-e7748bd0367c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789383109" status: 202 len: 0 microversion: 2.1 time: 0.022648 Jun 07 13:23:42.576926 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 319/656] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Jun 7 13:23:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789383109 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:23:42.678450 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:42.679138 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:42.687154 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:42.687854 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:42.688850 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:42.689519 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:42.704770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] HTTP exception thrown: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Request method failure captured: Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd HTTP/1.1 Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1Ca-DPRahE7U6wJfA_TS-oddu6O-I73txX2u1Z2sWh9wI856WP-g2rdzQTuyTYDTEsKT86KtHt5mFZC7ZjmG2A6p5iFaovEpl4sbNcAMXBD2X5lL7oKsxMeskoazifQIHdqq8xL_51ABA9Y5ktloFNZdQUMH_u7l3HLHnidXlTm38k Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:23:42.706335 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 36c5458a18f146be87207e0f6dd598eb Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:23:42.708307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '2015ad36-8c9d-42a6-b493-ebed58fb80bd'} Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:23:42.709211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:23:42.710585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:23:42.713951 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Returning 404 to user: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:23:42.715105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-01c2bc5d-97ed-41d2-8a31-f9da13bd714f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 404 len: 111 microversion: 2.1 time: 0.040544 Jun 07 13:23:42.716159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 338/657] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:42 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:23:42.869191 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1018047592", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1670039504", "security_groups": [{"name": "tempest-secgroup-smoke-2066727904"}], "block_device_mapping_v2": [{"uuid": "f7243ad9-969d-42e9-a826-7bfde4d0ca73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f22df14-4055-4a5c-b07f-b9c47fcaaaf4"}]}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:42.928889 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-f68f4c88-4d2c-4e65-b9fb-469d2744c4ba req-cd23b440-a910-40e3-b575-3973df62f29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2015ad36-8c9d-42a6-b493-ebed58fb80bd", "name": "network-vif-deleted", "tag": "110b12e8-380e-45f8-9b34-02595fa36a2c"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:42.939642 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f68f4c88-4d2c-4e65-b9fb-469d2744c4ba req-cd23b440-a910-40e3-b575-3973df62f29a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:42.940100 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f68f4c88-4d2c-4e65-b9fb-469d2744c4ba req-cd23b440-a910-40e3-b575-3973df62f29a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:42.971942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-f68f4c88-4d2c-4e65-b9fb-469d2744c4ba req-cd23b440-a910-40e3-b575-3973df62f29a service nova] Creating event network-vif-deleted:110b12e8-380e-45f8-9b34-02595fa36a2c for instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd on hv-cinder-84460 Jun 07 13:23:42.979444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-f68f4c88-4d2c-4e65-b9fb-469d2744c4ba req-cd23b440-a910-40e3-b575-3973df62f29a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054572 Jun 07 13:23:42.980789 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 339/658] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:43.048850 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] validate_networks() for [('9f22df14-4055-4a5c-b07f-b9c47fcaaaf4', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:23:43.490226 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1cfb70af-ecdd-4d5e-8112-221cc7c2f808 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: .version_select at 0x7f46a376dd30>, body: {"keypair": {"name": "tempest-keypair-1716070782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtOSb/jTEt6IE7+UznERX6kuuQZmL6e1FwH0Dhi97QCZoMQZ9PMUC0FCCNHu/jBpLz9W1obCGK+xd3dawAE5NPTTs4pP7hH/Xt6CMppsDas/HiGPdG/qSGAeBZAz4cHAw=="}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:43.511304 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-1cfb70af-ecdd-4d5e-8112-221cc7c2f808 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'key_pairs'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:43.517345 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-1cfb70af-ecdd-4d5e-8112-221cc7c2f808 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for user 49c60c4956f8479fbfe93f9f85a8d497 and project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'key_pairs'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:43.547411 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1cfb70af-ecdd-4d5e-8112-221cc7c2f808 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066705 Jun 07 13:23:43.550885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 340/659] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:23:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:43.799976 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:23:43.800480 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:23:43.801091 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:23:43.801677 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:23:43.802153 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:23:43.812517 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:43.813035 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:43.813898 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:43.814405 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:43.832900 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Getting quotas for project b562a09561af4197bf2835b31a9dd34e. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:43.836974 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Getting quotas for user 36c5458a18f146be87207e0f6dd598eb and project b562a09561af4197bf2835b31a9dd34e. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:43.922436 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:23:43.924689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7243ad9-969d-42e9-a826-7bfde4d0ca73',volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:23:44.125259 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0accd9b1-3753-4dd8-beb2-f7896bc7d98c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.262705 Jun 07 13:23:44.126549 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 320/660] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:23:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:23:44.137598 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-80e45549-a10b-4ff5-b11c-8004ff69d97b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:44.138595 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-80e45549-a10b-4ff5-b11c-8004ff69d97b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:44.239982 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-80e45549-a10b-4ff5-b11c-8004ff69d97b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:44.251478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-80e45549-a10b-4ff5-b11c-8004ff69d97b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1095 microversion: 2.1 time: 0.118702 Jun 07 13:23:44.254807 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 341/661] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:44 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1095 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:45.271110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-023ba6eb-a509-414e-b20c-eec407777b6c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:45.272399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-023ba6eb-a509-414e-b20c-eec407777b6c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:45.284086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-023ba6eb-a509-414e-b20c-eec407777b6c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:45.284815 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-023ba6eb-a509-414e-b20c-eec407777b6c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:45.285885 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-023ba6eb-a509-414e-b20c-eec407777b6c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:45.286480 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-023ba6eb-a509-414e-b20c-eec407777b6c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:45.376746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-023ba6eb-a509-414e-b20c-eec407777b6c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:45.389988 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-023ba6eb-a509-414e-b20c-eec407777b6c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1193 microversion: 2.1 time: 0.123187 Jun 07 13:23:45.391159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 321/662] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:45 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1193 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:45.534109 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-987439400", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7935e13c-3463-4221-bbf4-297a23e61ffb"}], "security_groups": [{"name": "tempest-securitygroup--857524956"}], "key_name": "tempest-keypair-1716070782", "user_data": "}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:45.682226 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] validate_networks() for [('7935e13c-3463-4221-bbf4-297a23e61ffb', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:23:46.279256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:23:46.279743 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:23:46.280214 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:23:46.280621 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:23:46.281033 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:23:46.291855 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:46.292504 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:46.293296 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:46.293727 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:46.316035 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:46.327322 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Getting quotas for user 49c60c4956f8479fbfe93f9f85a8d497 and project ec73e3d0e6f8476d81463ea6e11b62cd. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:46.342155 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:23:46.344657 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:23:46.407798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c51423d6-ddb4-45ba-9c82-2df0c2f18f42 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:46.408363 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-76e00fd5-f061-42bb-aa2f-40bedbb84392 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.878886 Jun 07 13:23:46.408466 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c51423d6-ddb4-45ba-9c82-2df0c2f18f42 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:46.409307 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 342/663] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:23:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:23:46.422447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7520508e-e80b-49a5-aa2f-10823f541c31 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:46.423210 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7520508e-e80b-49a5-aa2f-10823f541c31 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:46.425189 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c51423d6-ddb4-45ba-9c82-2df0c2f18f42 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:46.425648 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c51423d6-ddb4-45ba-9c82-2df0c2f18f42 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:46.426434 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c51423d6-ddb4-45ba-9c82-2df0c2f18f42 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:46.427396 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c51423d6-ddb4-45ba-9c82-2df0c2f18f42 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:46.490647 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7520508e-e80b-49a5-aa2f-10823f541c31 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:46.503352 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7520508e-e80b-49a5-aa2f-10823f541c31 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1241 microversion: 2.1 time: 0.086997 Jun 07 13:23:46.513545 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 343/664] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:46 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:46.589500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c51423d6-ddb4-45ba-9c82-2df0c2f18f42 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:46.598282 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c51423d6-ddb4-45ba-9c82-2df0c2f18f42 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1199 microversion: 2.1 time: 0.194311 Jun 07 13:23:46.599207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 322/665] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:46 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1199 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:47.522176 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-07ec72bb-c8c1-408e-a37c-578622d3e065 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:47.523213 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-07ec72bb-c8c1-408e-a37c-578622d3e065 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:47.542531 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-07ec72bb-c8c1-408e-a37c-578622d3e065 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:47.543153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-07ec72bb-c8c1-408e-a37c-578622d3e065 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:47.546362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-07ec72bb-c8c1-408e-a37c-578622d3e065 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:47.548006 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-07ec72bb-c8c1-408e-a37c-578622d3e065 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:47.646881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-07ec72bb-c8c1-408e-a37c-578622d3e065 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:47.658982 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-07ec72bb-c8c1-408e-a37c-578622d3e065 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1293 microversion: 2.1 time: 0.142798 Jun 07 13:23:47.669253 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 344/666] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:47 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1293 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:47.669253 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-feb115a9-df20-4e9f-8a26-1ecf11417a78 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:47.669253 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-feb115a9-df20-4e9f-8a26-1ecf11417a78 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:47.675733 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-feb115a9-df20-4e9f-8a26-1ecf11417a78 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:47.676190 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-feb115a9-df20-4e9f-8a26-1ecf11417a78 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:47.677225 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-feb115a9-df20-4e9f-8a26-1ecf11417a78 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:47.677856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-feb115a9-df20-4e9f-8a26-1ecf11417a78 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:47.778178 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0bb039d0-8361-4c31-b6ba-a937ecba412b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'create', calling method: .version_select at 0x7f46ac8a2670>, body: {"keypair": {"name": "tempest-keypair-1255008121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWEjnBiJlzdG5IPWrlOvXajvYQu0U1Mn6r9cdRSIJFIh+iJkA6Fta1tNHoZvG/4gnj+fSzIWH7oDyjKbpeWRFwyQdgoTHk0UcoxdfysLE5dPXN3scFSJU+d5R7+GW1mLg=="}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:47.811650 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-0bb039d0-8361-4c31-b6ba-a937ecba412b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Getting quotas for project 5541835571f64b4dbec6cabbbd6b13ca. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:47.824058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-0bb039d0-8361-4c31-b6ba-a937ecba412b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Getting quotas for user a5766b86063f4955a642ae59e28ee226 and project 5541835571f64b4dbec6cabbbd6b13ca. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:47.856835 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-feb115a9-df20-4e9f-8a26-1ecf11417a78 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:47.866582 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0bb039d0-8361-4c31-b6ba-a937ecba412b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.285770 Jun 07 13:23:47.868799 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 323/667] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:23:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:47.877829 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-feb115a9-df20-4e9f-8a26-1ecf11417a78 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.216666 Jun 07 13:23:47.878436 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 345/668] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:47 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:48.682357 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-14be64fe-79c3-40af-b194-d1e037225e17 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:48.683427 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-14be64fe-79c3-40af-b194-d1e037225e17 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:48.693149 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-14be64fe-79c3-40af-b194-d1e037225e17 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.694004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-14be64fe-79c3-40af-b194-d1e037225e17 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:48.695096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-14be64fe-79c3-40af-b194-d1e037225e17 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.695791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-14be64fe-79c3-40af-b194-d1e037225e17 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:48.896242 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-86de3d71-4c8f-437c-a8b5-2b67032a171b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:48.896868 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-86de3d71-4c8f-437c-a8b5-2b67032a171b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:48.907685 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-86de3d71-4c8f-437c-a8b5-2b67032a171b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.908193 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-86de3d71-4c8f-437c-a8b5-2b67032a171b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:48.908974 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-86de3d71-4c8f-437c-a8b5-2b67032a171b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.909430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-86de3d71-4c8f-437c-a8b5-2b67032a171b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:49.067509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-14be64fe-79c3-40af-b194-d1e037225e17 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:49.078269 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-14be64fe-79c3-40af-b194-d1e037225e17 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1299 microversion: 2.1 time: 0.405106 Jun 07 13:23:49.083135 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 324/669] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:48 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1299 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:49.095964 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-1a1bfded-2be2-4a52-a8cf-4fd4247fbc92 req-f7d3451c-899b-4f98-9649-84d750944b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e44fbd-542f-491b-924a-b344febacc9e", "tag": "d6ca44d9-1b5d-4453-991d-603401049b3a"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:49.109961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-1a1bfded-2be2-4a52-a8cf-4fd4247fbc92 req-f7d3451c-899b-4f98-9649-84d750944b8d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:49.110744 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-1a1bfded-2be2-4a52-a8cf-4fd4247fbc92 req-f7d3451c-899b-4f98-9649-84d750944b8d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:49.123959 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-1a1bfded-2be2-4a52-a8cf-4fd4247fbc92 req-f7d3451c-899b-4f98-9649-84d750944b8d service nova] Creating event network-changed:d6ca44d9-1b5d-4453-991d-603401049b3a for instance 64e44fbd-542f-491b-924a-b344febacc9e on hv-cinder-84460 Jun 07 13:23:49.129773 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-1a1bfded-2be2-4a52-a8cf-4fd4247fbc92 req-f7d3451c-899b-4f98-9649-84d750944b8d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045209 Jun 07 13:23:49.131036 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 325/670] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:49.217845 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-86de3d71-4c8f-437c-a8b5-2b67032a171b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:49.232665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-86de3d71-4c8f-437c-a8b5-2b67032a171b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.340215 Jun 07 13:23:49.235559 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 346/671] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:48 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:49.903537 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-20198552", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d03f50ab-3c90-41eb-b646-98d9eb95947d"}], "security_groups": [{"name": "tempest-securitygroup--820768424"}], "key_name": "tempest-keypair-1255008121", "user_data": "}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:50.044035 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] validate_networks() for [('d03f50ab-3c90-41eb-b646-98d9eb95947d', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:23:50.098712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-48629a3d-dada-4811-a914-c53bbf96b801 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:50.100073 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-48629a3d-dada-4811-a914-c53bbf96b801 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:50.112657 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:50.117174 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-48629a3d-dada-4811-a914-c53bbf96b801 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.118538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-48629a3d-dada-4811-a914-c53bbf96b801 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:50.120097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-48629a3d-dada-4811-a914-c53bbf96b801 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.120852 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-48629a3d-dada-4811-a914-c53bbf96b801 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:50.371608 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-48629a3d-dada-4811-a914-c53bbf96b801 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:50.390780 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-48629a3d-dada-4811-a914-c53bbf96b801 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1366 microversion: 2.1 time: 0.295771 Jun 07 13:23:50.391914 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 347/672] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:50 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:50.443983 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c5a9c7cd-f668-4440-abe6-8d002f03f2f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:50.444623 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c5a9c7cd-f668-4440-abe6-8d002f03f2f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:50.454272 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5a9c7cd-f668-4440-abe6-8d002f03f2f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.454731 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5a9c7cd-f668-4440-abe6-8d002f03f2f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:50.459468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5a9c7cd-f668-4440-abe6-8d002f03f2f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.460605 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5a9c7cd-f668-4440-abe6-8d002f03f2f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:50.469184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:50.667684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c5a9c7cd-f668-4440-abe6-8d002f03f2f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:50.676960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c5a9c7cd-f668-4440-abe6-8d002f03f2f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.278714 Jun 07 13:23:50.678968 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 348/673] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:50 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:50.814582 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:23:50.815121 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:23:50.815513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:23:50.815918 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:23:50.816755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:23:50.830485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.831097 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:50.831977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.832487 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:50.853722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Getting quotas for project 5541835571f64b4dbec6cabbbd6b13ca. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:50.858546 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Getting quotas for user a5766b86063f4955a642ae59e28ee226 and project 5541835571f64b4dbec6cabbbd6b13ca. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:50.883895 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:23:50.891611 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:23:50.960381 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-000d827d-095f-449f-9a08-8de578397399 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.063974 Jun 07 13:23:50.962415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 326/674] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:23:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:23:50.972549 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-bf7239e5-e47f-41b4-9370-0d067a3668a7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:50.973173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-bf7239e5-e47f-41b4-9370-0d067a3668a7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:51.063648 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-bf7239e5-e47f-41b4-9370-0d067a3668a7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:51.072356 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-bf7239e5-e47f-41b4-9370-0d067a3668a7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1236 microversion: 2.1 time: 0.102894 Jun 07 13:23:51.072956 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 349/675] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:50 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:51.148409 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-e066221f-ae0b-4891-a0c7-20968ea825dc req-29133faa-f20a-46bc-b220-e79e7c6dd663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f885ff03-d893-4004-9674-c64cc19f2ace", "tag": "cbc5aa4d-f9b4-4263-a137-129218b1ded5"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:51.156527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:51.160272 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-e066221f-ae0b-4891-a0c7-20968ea825dc req-29133faa-f20a-46bc-b220-e79e7c6dd663 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:51.161534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-e066221f-ae0b-4891-a0c7-20968ea825dc req-29133faa-f20a-46bc-b220-e79e7c6dd663 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:51.178958 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-e066221f-ae0b-4891-a0c7-20968ea825dc req-29133faa-f20a-46bc-b220-e79e7c6dd663 service nova] Creating event network-changed:cbc5aa4d-f9b4-4263-a137-129218b1ded5 for instance f885ff03-d893-4004-9674-c64cc19f2ace on hv-cinder-84460 Jun 07 13:23:51.187117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-e066221f-ae0b-4891-a0c7-20968ea825dc req-29133faa-f20a-46bc-b220-e79e7c6dd663 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042318 Jun 07 13:23:51.188251 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 327/676] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:51.408704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-96246bb6-600a-46c3-b962-9405ca5294f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:51.409330 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-96246bb6-600a-46c3-b962-9405ca5294f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:51.416485 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96246bb6-600a-46c3-b962-9405ca5294f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:51.417209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96246bb6-600a-46c3-b962-9405ca5294f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:51.418233 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96246bb6-600a-46c3-b962-9405ca5294f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:51.418847 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96246bb6-600a-46c3-b962-9405ca5294f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:51.566501 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-96246bb6-600a-46c3-b962-9405ca5294f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:51.574746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-96246bb6-600a-46c3-b962-9405ca5294f3 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1366 microversion: 2.1 time: 0.170416 Jun 07 13:23:51.575359 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 350/677] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:51 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:51.694321 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2d03447d-c928-4a83-9629-9dcd27402798 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:51.695135 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2d03447d-c928-4a83-9629-9dcd27402798 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:51.703056 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2d03447d-c928-4a83-9629-9dcd27402798 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:51.703501 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2d03447d-c928-4a83-9629-9dcd27402798 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:51.704275 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2d03447d-c928-4a83-9629-9dcd27402798 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:51.704703 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2d03447d-c928-4a83-9629-9dcd27402798 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:51.837967 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2d03447d-c928-4a83-9629-9dcd27402798 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:51.846183 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2d03447d-c928-4a83-9629-9dcd27402798 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.156120 Jun 07 13:23:51.846751 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 328/678] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:51 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:52.089459 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-797cc326-d8b3-425f-b8ae-b05b1b536679 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:52.090072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-797cc326-d8b3-425f-b8ae-b05b1b536679 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:52.096208 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-797cc326-d8b3-425f-b8ae-b05b1b536679 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:52.096660 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-797cc326-d8b3-425f-b8ae-b05b1b536679 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:52.097455 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-797cc326-d8b3-425f-b8ae-b05b1b536679 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:52.097891 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-797cc326-d8b3-425f-b8ae-b05b1b536679 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:52.162591 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-797cc326-d8b3-425f-b8ae-b05b1b536679 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:52.170588 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-797cc326-d8b3-425f-b8ae-b05b1b536679 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1240 microversion: 2.1 time: 0.085076 Jun 07 13:23:52.171273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 351/679] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:52 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:52.592167 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-46909e66-df54-4edf-85fd-12ab5c12bf21 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:52.592771 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-46909e66-df54-4edf-85fd-12ab5c12bf21 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:52.599156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-46909e66-df54-4edf-85fd-12ab5c12bf21 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:52.599601 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-46909e66-df54-4edf-85fd-12ab5c12bf21 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:52.600347 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-46909e66-df54-4edf-85fd-12ab5c12bf21 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:52.600777 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-46909e66-df54-4edf-85fd-12ab5c12bf21 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:52.726056 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-46909e66-df54-4edf-85fd-12ab5c12bf21 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:52.733665 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-46909e66-df54-4edf-85fd-12ab5c12bf21 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1366 microversion: 2.1 time: 0.145319 Jun 07 13:23:52.734220 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 329/680] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:52 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:52.863163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-816d6768-e726-494a-a590-cbf2bc60b366 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:52.863780 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-816d6768-e726-494a-a590-cbf2bc60b366 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:52.870330 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-816d6768-e726-494a-a590-cbf2bc60b366 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:52.871073 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-816d6768-e726-494a-a590-cbf2bc60b366 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:52.872004 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-816d6768-e726-494a-a590-cbf2bc60b366 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:52.872293 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-816d6768-e726-494a-a590-cbf2bc60b366 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:53.015671 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-816d6768-e726-494a-a590-cbf2bc60b366 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:53.023660 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-816d6768-e726-494a-a590-cbf2bc60b366 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.164291 Jun 07 13:23:53.024917 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 352/681] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:52 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:53.187970 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f69750c0-9cf5-4458-aa9a-e7a1d238c15f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:53.189323 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f69750c0-9cf5-4458-aa9a-e7a1d238c15f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:53.195774 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f69750c0-9cf5-4458-aa9a-e7a1d238c15f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:53.196307 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f69750c0-9cf5-4458-aa9a-e7a1d238c15f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:53.197250 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f69750c0-9cf5-4458-aa9a-e7a1d238c15f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:53.197839 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f69750c0-9cf5-4458-aa9a-e7a1d238c15f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:53.265093 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f69750c0-9cf5-4458-aa9a-e7a1d238c15f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:53.272819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f69750c0-9cf5-4458-aa9a-e7a1d238c15f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1294 microversion: 2.1 time: 0.088579 Jun 07 13:23:53.273718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 330/682] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:53 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:53.749654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-afb12af7-bf34-407b-91e7-bbe3f3491549 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:53.750187 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-afb12af7-bf34-407b-91e7-bbe3f3491549 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:53.756528 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-afb12af7-bf34-407b-91e7-bbe3f3491549 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:53.757011 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-afb12af7-bf34-407b-91e7-bbe3f3491549 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:53.757861 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-afb12af7-bf34-407b-91e7-bbe3f3491549 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:53.758308 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-afb12af7-bf34-407b-91e7-bbe3f3491549 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:53.890604 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-afb12af7-bf34-407b-91e7-bbe3f3491549 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:53.897968 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-afb12af7-bf34-407b-91e7-bbe3f3491549 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1366 microversion: 2.1 time: 0.152271 Jun 07 13:23:53.898543 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 353/683] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:53 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:54.042067 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-db6fdd1a-9de9-485e-8e0e-44823c3510a5 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:54.042963 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-db6fdd1a-9de9-485e-8e0e-44823c3510a5 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:54.050022 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db6fdd1a-9de9-485e-8e0e-44823c3510a5 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:54.050569 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db6fdd1a-9de9-485e-8e0e-44823c3510a5 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:54.051423 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db6fdd1a-9de9-485e-8e0e-44823c3510a5 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:54.052143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-db6fdd1a-9de9-485e-8e0e-44823c3510a5 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:54.194413 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-db6fdd1a-9de9-485e-8e0e-44823c3510a5 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:54.204043 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-db6fdd1a-9de9-485e-8e0e-44823c3510a5 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.166685 Jun 07 13:23:54.204795 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 331/684] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:54 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:54.289454 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a702cbe6-2150-4b98-9711-1e5786738d5a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:54.290026 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a702cbe6-2150-4b98-9711-1e5786738d5a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:54.296262 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a702cbe6-2150-4b98-9711-1e5786738d5a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:54.296677 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a702cbe6-2150-4b98-9711-1e5786738d5a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:54.297544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a702cbe6-2150-4b98-9711-1e5786738d5a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:54.298124 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a702cbe6-2150-4b98-9711-1e5786738d5a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:54.437118 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a702cbe6-2150-4b98-9711-1e5786738d5a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:54.445732 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a702cbe6-2150-4b98-9711-1e5786738d5a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1361 microversion: 2.1 time: 0.160058 Jun 07 13:23:54.446817 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 354/685] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:54 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:54.700285 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-20d23321-d082-4735-933c-72fd7c1dda06 req-dacf265c-3064-48a9-b245-f12c2e1c511d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5264ef-a5c4-498e-8c65-af627dcfa757", "tag": "1d4702b2-63b5-41cf-b9f0-f021d1576e6f"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:54.712104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-20d23321-d082-4735-933c-72fd7c1dda06 req-dacf265c-3064-48a9-b245-f12c2e1c511d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:54.713740 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-20d23321-d082-4735-933c-72fd7c1dda06 req-dacf265c-3064-48a9-b245-f12c2e1c511d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:54.730734 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-20d23321-d082-4735-933c-72fd7c1dda06 req-dacf265c-3064-48a9-b245-f12c2e1c511d service nova] Creating event network-changed:1d4702b2-63b5-41cf-b9f0-f021d1576e6f for instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 on hv-cinder-84460 Jun 07 13:23:54.736103 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-20d23321-d082-4735-933c-72fd7c1dda06 req-dacf265c-3064-48a9-b245-f12c2e1c511d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041426 Jun 07 13:23:54.737534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 332/686] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:54.915847 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a4388691-7d87-44d1-bc2d-fda509535c56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:54.916580 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a4388691-7d87-44d1-bc2d-fda509535c56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:54.922609 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a4388691-7d87-44d1-bc2d-fda509535c56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:54.923179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a4388691-7d87-44d1-bc2d-fda509535c56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:54.923948 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a4388691-7d87-44d1-bc2d-fda509535c56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:54.924389 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a4388691-7d87-44d1-bc2d-fda509535c56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:55.049681 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a4388691-7d87-44d1-bc2d-fda509535c56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:55.057821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a4388691-7d87-44d1-bc2d-fda509535c56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1366 microversion: 2.1 time: 0.146354 Jun 07 13:23:55.058400 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 355/687] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:54 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:55.222156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b93b54bd-887e-43db-aee4-06a63e52eaca tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:55.222987 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b93b54bd-887e-43db-aee4-06a63e52eaca tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:55.230468 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b93b54bd-887e-43db-aee4-06a63e52eaca tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:55.230948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b93b54bd-887e-43db-aee4-06a63e52eaca tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:55.231973 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b93b54bd-887e-43db-aee4-06a63e52eaca tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:55.232404 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b93b54bd-887e-43db-aee4-06a63e52eaca tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:55.340187 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-c2959aa4-7d9f-405f-9e43-4d9b43068e3e req-d60fb5b8-360a-4fcf-b778-9cad9bdfbfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f885ff03-d893-4004-9674-c64cc19f2ace", "name": "network-vif-plugged", "status": "completed", "tag": "cbc5aa4d-f9b4-4263-a137-129218b1ded5"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:55.349099 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-c2959aa4-7d9f-405f-9e43-4d9b43068e3e req-d60fb5b8-360a-4fcf-b778-9cad9bdfbfba service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:55.349547 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-c2959aa4-7d9f-405f-9e43-4d9b43068e3e req-d60fb5b8-360a-4fcf-b778-9cad9bdfbfba service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:55.361754 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-c2959aa4-7d9f-405f-9e43-4d9b43068e3e req-d60fb5b8-360a-4fcf-b778-9cad9bdfbfba service nova] Creating event network-vif-plugged:cbc5aa4d-f9b4-4263-a137-129218b1ded5 for instance f885ff03-d893-4004-9674-c64cc19f2ace on hv-cinder-84460 Jun 07 13:23:55.366720 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-c2959aa4-7d9f-405f-9e43-4d9b43068e3e req-d60fb5b8-360a-4fcf-b778-9cad9bdfbfba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098649 Jun 07 13:23:55.367497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 356/688] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:55.383734 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b93b54bd-887e-43db-aee4-06a63e52eaca tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:55.391288 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b93b54bd-887e-43db-aee4-06a63e52eaca tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.173361 Jun 07 13:23:55.391850 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 333/689] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:55 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:55.464039 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7d4b571b-a3db-4371-8b5b-dbd1116c530a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:55.464735 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7d4b571b-a3db-4371-8b5b-dbd1116c530a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:55.471003 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d4b571b-a3db-4371-8b5b-dbd1116c530a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:55.471450 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d4b571b-a3db-4371-8b5b-dbd1116c530a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:55.472238 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d4b571b-a3db-4371-8b5b-dbd1116c530a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:55.472672 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7d4b571b-a3db-4371-8b5b-dbd1116c530a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:55.598816 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7d4b571b-a3db-4371-8b5b-dbd1116c530a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:55.606121 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7d4b571b-a3db-4371-8b5b-dbd1116c530a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1361 microversion: 2.1 time: 0.146878 Jun 07 13:23:55.606964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 357/690] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:55 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:56.075377 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-abc4efbb-aa14-4770-8cd0-141cfb5f9311 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:56.075909 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-abc4efbb-aa14-4770-8cd0-141cfb5f9311 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:56.081843 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abc4efbb-aa14-4770-8cd0-141cfb5f9311 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:56.082291 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abc4efbb-aa14-4770-8cd0-141cfb5f9311 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:56.083070 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abc4efbb-aa14-4770-8cd0-141cfb5f9311 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:56.083493 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abc4efbb-aa14-4770-8cd0-141cfb5f9311 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:56.210591 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-abc4efbb-aa14-4770-8cd0-141cfb5f9311 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:56.218148 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-abc4efbb-aa14-4770-8cd0-141cfb5f9311 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1366 microversion: 2.1 time: 0.147275 Jun 07 13:23:56.218709 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 334/691] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:56 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:56.408370 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-18c7b504-138c-42ee-8d0c-34d027b74b96 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:56.408927 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-18c7b504-138c-42ee-8d0c-34d027b74b96 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:56.410939 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:56.416374 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-18c7b504-138c-42ee-8d0c-34d027b74b96 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:56.416858 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-18c7b504-138c-42ee-8d0c-34d027b74b96 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:56.417624 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-18c7b504-138c-42ee-8d0c-34d027b74b96 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:56.418064 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-18c7b504-138c-42ee-8d0c-34d027b74b96 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:56.548794 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-18c7b504-138c-42ee-8d0c-34d027b74b96 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:56.556830 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-18c7b504-138c-42ee-8d0c-34d027b74b96 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.152315 Jun 07 13:23:56.557401 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 358/692] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:56 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:56.623524 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-17aa8aab-9968-4e94-83fc-2df562f6f279 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:56.624137 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-17aa8aab-9968-4e94-83fc-2df562f6f279 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:56.630556 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-17aa8aab-9968-4e94-83fc-2df562f6f279 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:56.631037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-17aa8aab-9968-4e94-83fc-2df562f6f279 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:56.631796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-17aa8aab-9968-4e94-83fc-2df562f6f279 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:56.632229 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-17aa8aab-9968-4e94-83fc-2df562f6f279 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:56.760369 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-17aa8aab-9968-4e94-83fc-2df562f6f279 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:56.768300 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-17aa8aab-9968-4e94-83fc-2df562f6f279 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1361 microversion: 2.1 time: 0.148540 Jun 07 13:23:56.769122 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 335/693] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:56 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:57.235828 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cee021eb-6184-4e44-995c-95a3e58eb8af tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:57.236459 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-cee021eb-6184-4e44-995c-95a3e58eb8af tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:57.243115 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cee021eb-6184-4e44-995c-95a3e58eb8af tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:57.243589 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cee021eb-6184-4e44-995c-95a3e58eb8af tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:57.244374 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cee021eb-6184-4e44-995c-95a3e58eb8af tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:57.244818 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cee021eb-6184-4e44-995c-95a3e58eb8af tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:57.381751 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-cee021eb-6184-4e44-995c-95a3e58eb8af tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:57.389828 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-cee021eb-6184-4e44-995c-95a3e58eb8af tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1366 microversion: 2.1 time: 0.158172 Jun 07 13:23:57.390605 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 359/694] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:57 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:57.574030 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d6eb0b6a-5d0b-4e2a-b6a6-d479599dfb46 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:57.574572 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d6eb0b6a-5d0b-4e2a-b6a6-d479599dfb46 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:57.580779 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d6eb0b6a-5d0b-4e2a-b6a6-d479599dfb46 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:57.581227 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d6eb0b6a-5d0b-4e2a-b6a6-d479599dfb46 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:57.581980 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d6eb0b6a-5d0b-4e2a-b6a6-d479599dfb46 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:57.582411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d6eb0b6a-5d0b-4e2a-b6a6-d479599dfb46 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:57.586559 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=100 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:57.716933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d6eb0b6a-5d0b-4e2a-b6a6-d479599dfb46 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:57.724811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d6eb0b6a-5d0b-4e2a-b6a6-d479599dfb46 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.155293 Jun 07 13:23:57.725385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 336/695] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:57 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:57.785654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a35d0b75-6955-4b2e-8efd-fd2d50ed12b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:57.786267 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a35d0b75-6955-4b2e-8efd-fd2d50ed12b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:57.792583 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a35d0b75-6955-4b2e-8efd-fd2d50ed12b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:57.793034 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a35d0b75-6955-4b2e-8efd-fd2d50ed12b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:57.793791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a35d0b75-6955-4b2e-8efd-fd2d50ed12b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:57.794224 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a35d0b75-6955-4b2e-8efd-fd2d50ed12b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:57.922583 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a35d0b75-6955-4b2e-8efd-fd2d50ed12b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:57.930248 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a35d0b75-6955-4b2e-8efd-fd2d50ed12b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1361 microversion: 2.1 time: 0.148301 Jun 07 13:23:57.930813 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 360/696] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:57 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:58.406962 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d768fda9-eb18-4351-888d-3a79baff5b96 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:58.407580 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d768fda9-eb18-4351-888d-3a79baff5b96 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:58.413666 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d768fda9-eb18-4351-888d-3a79baff5b96 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:58.414387 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d768fda9-eb18-4351-888d-3a79baff5b96 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:58.415183 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d768fda9-eb18-4351-888d-3a79baff5b96 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:58.415623 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d768fda9-eb18-4351-888d-3a79baff5b96 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:58.541489 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d768fda9-eb18-4351-888d-3a79baff5b96 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:58.549292 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d768fda9-eb18-4351-888d-3a79baff5b96 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1366 microversion: 2.1 time: 0.146277 Jun 07 13:23:58.549865 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 337/697] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:58 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:58.741514 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5675632f-d71f-40fc-a0ac-5e52a34ab048 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:58.742133 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5675632f-d71f-40fc-a0ac-5e52a34ab048 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:58.748893 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5675632f-d71f-40fc-a0ac-5e52a34ab048 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:58.749346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5675632f-d71f-40fc-a0ac-5e52a34ab048 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:58.750104 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5675632f-d71f-40fc-a0ac-5e52a34ab048 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:58.750543 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5675632f-d71f-40fc-a0ac-5e52a34ab048 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:58.884998 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5675632f-d71f-40fc-a0ac-5e52a34ab048 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:58.892594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5675632f-d71f-40fc-a0ac-5e52a34ab048 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.155023 Jun 07 13:23:58.893163 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 361/698] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:58 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:58.946872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2ea9517f-ed30-4480-aee8-56c92a5dbf03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:58.947418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2ea9517f-ed30-4480-aee8-56c92a5dbf03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:58.954048 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ea9517f-ed30-4480-aee8-56c92a5dbf03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:58.954495 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ea9517f-ed30-4480-aee8-56c92a5dbf03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:58.955275 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ea9517f-ed30-4480-aee8-56c92a5dbf03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:58.955709 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ea9517f-ed30-4480-aee8-56c92a5dbf03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:59.084703 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2ea9517f-ed30-4480-aee8-56c92a5dbf03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:59.092545 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2ea9517f-ed30-4480-aee8-56c92a5dbf03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1361 microversion: 2.1 time: 0.149639 Jun 07 13:23:59.093109 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 338/699] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:58 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:59.454318 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-868b2109-3601-4fc1-bdc2-ac04ae0fee20 req-7f273ce7-0224-4a2e-b9d4-8e1ef44b9bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e44fbd-542f-491b-924a-b344febacc9e", "name": "network-vif-plugged", "status": "completed", "tag": "d6ca44d9-1b5d-4453-991d-603401049b3a"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:59.463695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-868b2109-3601-4fc1-bdc2-ac04ae0fee20 req-7f273ce7-0224-4a2e-b9d4-8e1ef44b9bc6 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:59.464146 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-868b2109-3601-4fc1-bdc2-ac04ae0fee20 req-7f273ce7-0224-4a2e-b9d4-8e1ef44b9bc6 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:59.479228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-868b2109-3601-4fc1-bdc2-ac04ae0fee20 req-7f273ce7-0224-4a2e-b9d4-8e1ef44b9bc6 service nova] Creating event network-vif-plugged:d6ca44d9-1b5d-4453-991d-603401049b3a for instance 64e44fbd-542f-491b-924a-b344febacc9e on hv-cinder-84460 Jun 07 13:23:59.486645 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-868b2109-3601-4fc1-bdc2-ac04ae0fee20 req-7f273ce7-0224-4a2e-b9d4-8e1ef44b9bc6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036318 Jun 07 13:23:59.487874 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 362/700] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:59.566935 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-006e79ea-204f-4e97-9911-f6389939a145 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:59.567630 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-006e79ea-204f-4e97-9911-f6389939a145 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:59.574106 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-006e79ea-204f-4e97-9911-f6389939a145 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:59.574550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-006e79ea-204f-4e97-9911-f6389939a145 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:59.575365 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-006e79ea-204f-4e97-9911-f6389939a145 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:59.575798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-006e79ea-204f-4e97-9911-f6389939a145 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:59.711373 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-006e79ea-204f-4e97-9911-f6389939a145 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:59.718984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-006e79ea-204f-4e97-9911-f6389939a145 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1557 microversion: 2.1 time: 0.156016 Jun 07 13:23:59.730467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 339/701] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:59 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:59.737077 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e85237cf-66dc-4de6-b689-a2179236bc3c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:59.737666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e85237cf-66dc-4de6-b689-a2179236bc3c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:59.744671 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e85237cf-66dc-4de6-b689-a2179236bc3c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:59.745150 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e85237cf-66dc-4de6-b689-a2179236bc3c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:59.746042 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e85237cf-66dc-4de6-b689-a2179236bc3c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:59.746491 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e85237cf-66dc-4de6-b689-a2179236bc3c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:59.828487 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e85237cf-66dc-4de6-b689-a2179236bc3c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095687 Jun 07 13:23:59.829425 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 363/702] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Jun 7 13:23:59 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:59.909469 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2ff72d24-d886-41b9-9dbc-57150a0fdd9d tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:59.910205 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2ff72d24-d886-41b9-9dbc-57150a0fdd9d tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:59.916571 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ff72d24-d886-41b9-9dbc-57150a0fdd9d tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:59.917027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ff72d24-d886-41b9-9dbc-57150a0fdd9d tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:59.917826 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ff72d24-d886-41b9-9dbc-57150a0fdd9d tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:59.918260 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2ff72d24-d886-41b9-9dbc-57150a0fdd9d tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:00.109581 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-669052e6-47a3-4d42-adce-2457fe51a5a0 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:00.110231 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-669052e6-47a3-4d42-adce-2457fe51a5a0 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:00.116340 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-669052e6-47a3-4d42-adce-2457fe51a5a0 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:00.116804 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-669052e6-47a3-4d42-adce-2457fe51a5a0 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:00.117602 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-669052e6-47a3-4d42-adce-2457fe51a5a0 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:00.118562 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-669052e6-47a3-4d42-adce-2457fe51a5a0 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:00.155957 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2ff72d24-d886-41b9-9dbc-57150a0fdd9d tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:00.163490 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2ff72d24-d886-41b9-9dbc-57150a0fdd9d tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.257919 Jun 07 13:24:00.164090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 340/703] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:59 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:00.362924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-669052e6-47a3-4d42-adce-2457fe51a5a0 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:00.371433 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-669052e6-47a3-4d42-adce-2457fe51a5a0 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1361 microversion: 2.1 time: 0.265777 Jun 07 13:24:00.372197 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 364/704] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:00 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:24:01.091590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=4 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:01.092363 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=16 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:01.147698 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-1cdb2ced-7d59-434d-bd28-4287d4b56dad req-7dad9ae3-b722-4d1f-91a2-cea8cba266a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f885ff03-d893-4004-9674-c64cc19f2ace", "tag": "cbc5aa4d-f9b4-4263-a137-129218b1ded5"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:01.156122 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-1cdb2ced-7d59-434d-bd28-4287d4b56dad req-7dad9ae3-b722-4d1f-91a2-cea8cba266a0 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:01.156747 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-1cdb2ced-7d59-434d-bd28-4287d4b56dad req-7dad9ae3-b722-4d1f-91a2-cea8cba266a0 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:01.168692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-1cdb2ced-7d59-434d-bd28-4287d4b56dad req-7dad9ae3-b722-4d1f-91a2-cea8cba266a0 service nova] Creating event network-changed:cbc5aa4d-f9b4-4263-a137-129218b1ded5 for instance f885ff03-d893-4004-9674-c64cc19f2ace on hv-cinder-84460 Jun 07 13:24:01.173522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-1cdb2ced-7d59-434d-bd28-4287d4b56dad req-7dad9ae3-b722-4d1f-91a2-cea8cba266a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086289 Jun 07 13:24:01.174146 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 341/705] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:24:01.181714 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-364324e1-855f-494f-ac4f-4280bf450dd7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:01.182415 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-364324e1-855f-494f-ac4f-4280bf450dd7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:01.190510 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=16 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:01.192969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-364324e1-855f-494f-ac4f-4280bf450dd7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:01.194092 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-364324e1-855f-494f-ac4f-4280bf450dd7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:01.194563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-364324e1-855f-494f-ac4f-4280bf450dd7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:01.195076 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-364324e1-855f-494f-ac4f-4280bf450dd7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:01.344006 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-364324e1-855f-494f-ac4f-4280bf450dd7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:01.352866 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-364324e1-855f-494f-ac4f-4280bf450dd7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1267 microversion: 2.1 time: 0.175157 Jun 07 13:24:01.353998 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 365/706] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:01 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:24:01.389814 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b8889140-9350-4cbf-970c-518075899964 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:01.390509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b8889140-9350-4cbf-970c-518075899964 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:01.396718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8889140-9350-4cbf-970c-518075899964 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:01.397173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8889140-9350-4cbf-970c-518075899964 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:01.397937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8889140-9350-4cbf-970c-518075899964 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:01.398371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b8889140-9350-4cbf-970c-518075899964 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:01.517387 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-18afa49a-5e11-451b-97b6-8e7b682a878b req-c915ca72-5e55-466c-a731-a3689dbcf092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5264ef-a5c4-498e-8c65-af627dcfa757", "name": "network-vif-plugged", "status": "completed", "tag": "1d4702b2-63b5-41cf-b9f0-f021d1576e6f"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:01.535944 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-18afa49a-5e11-451b-97b6-8e7b682a878b req-c915ca72-5e55-466c-a731-a3689dbcf092 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:01.536403 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b8889140-9350-4cbf-970c-518075899964 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:01.537042 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-18afa49a-5e11-451b-97b6-8e7b682a878b req-c915ca72-5e55-466c-a731-a3689dbcf092 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:01.548595 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b8889140-9350-4cbf-970c-518075899964 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1361 microversion: 2.1 time: 0.161437 Jun 07 13:24:01.549304 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 342/707] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:01 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:01.551898 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-18afa49a-5e11-451b-97b6-8e7b682a878b req-c915ca72-5e55-466c-a731-a3689dbcf092 service nova] Creating event network-vif-plugged:1d4702b2-63b5-41cf-b9f0-f021d1576e6f for instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 on hv-cinder-84460 Jun 07 13:24:01.560392 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-18afa49a-5e11-451b-97b6-8e7b682a878b req-c915ca72-5e55-466c-a731-a3689dbcf092 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053080 Jun 07 13:24:01.561729 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 366/708] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:24:02.370241 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b3d5d3ce-f1c2-403d-a19f-3edd66a73d5e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:02.370864 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b3d5d3ce-f1c2-403d-a19f-3edd66a73d5e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:02.377351 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3ce-f1c2-403d-a19f-3edd66a73d5e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.377796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3ce-f1c2-403d-a19f-3edd66a73d5e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.378548 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3ce-f1c2-403d-a19f-3edd66a73d5e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.379029 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3ce-f1c2-403d-a19f-3edd66a73d5e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.510937 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b3d5d3ce-f1c2-403d-a19f-3edd66a73d5e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:02.518419 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b3d5d3ce-f1c2-403d-a19f-3edd66a73d5e tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1453 microversion: 2.1 time: 0.152144 Jun 07 13:24:02.519016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 343/709] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:02 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:02.535501 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-004e706b-78a5-4952-a9eb-30f078fdeaf9 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:02.536199 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-004e706b-78a5-4952-a9eb-30f078fdeaf9 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:02.542322 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-004e706b-78a5-4952-a9eb-30f078fdeaf9 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.542775 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-004e706b-78a5-4952-a9eb-30f078fdeaf9 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.543581 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-004e706b-78a5-4952-a9eb-30f078fdeaf9 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.544026 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-004e706b-78a5-4952-a9eb-30f078fdeaf9 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.566922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-97c661a8-3ce4-44f2-8a4e-f9dd815f87e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:02.567532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-97c661a8-3ce4-44f2-8a4e-f9dd815f87e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:02.573992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-97c661a8-3ce4-44f2-8a4e-f9dd815f87e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.574443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-97c661a8-3ce4-44f2-8a4e-f9dd815f87e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.575352 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-97c661a8-3ce4-44f2-8a4e-f9dd815f87e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:02.575783 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-97c661a8-3ce4-44f2-8a4e-f9dd815f87e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:02.721216 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-004e706b-78a5-4952-a9eb-30f078fdeaf9 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:02.728714 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-004e706b-78a5-4952-a9eb-30f078fdeaf9 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1453 microversion: 2.1 time: 0.197435 Jun 07 13:24:02.729496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 367/710] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:02 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:02.758278 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-97c661a8-3ce4-44f2-8a4e-f9dd815f87e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:02.766548 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-97c661a8-3ce4-44f2-8a4e-f9dd815f87e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1361 microversion: 2.1 time: 0.203555 Jun 07 13:24:02.767156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 344/711] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:02 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:24:03.783885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a61cefba-87a3-4121-bb79-99f57a249b16 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:03.784657 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a61cefba-87a3-4121-bb79-99f57a249b16 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:03.790688 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a61cefba-87a3-4121-bb79-99f57a249b16 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:03.791882 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a61cefba-87a3-4121-bb79-99f57a249b16 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:03.792155 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a61cefba-87a3-4121-bb79-99f57a249b16 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:03.792724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a61cefba-87a3-4121-bb79-99f57a249b16 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:03.797949 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=100 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:03.908197 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0baceed7-9f3b-43e6-b80c-951a2963ed73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:03.908755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0baceed7-9f3b-43e6-b80c-951a2963ed73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:03.915500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-9f3b-43e6-b80c-951a2963ed73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:03.915946 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-9f3b-43e6-b80c-951a2963ed73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:03.916735 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-9f3b-43e6-b80c-951a2963ed73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:03.917358 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-9f3b-43e6-b80c-951a2963ed73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:03.946771 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0baceed7-9f3b-43e6-b80c-951a2963ed73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/ips" status: 200 len: 151 microversion: 2.20 time: 0.042404 Jun 07 13:24:03.947521 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 345/712] 10.222.0.61 () {60 vars in 1288 bytes} [Tue Jun 7 13:24:03 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:24:04.024910 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a61cefba-87a3-4121-bb79-99f57a249b16 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:04.032728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a61cefba-87a3-4121-bb79-99f57a249b16 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1547 microversion: 2.1 time: 0.253222 Jun 07 13:24:04.033388 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 368/713] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:03 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1547 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:04.052084 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-377c187a-1a13-4c3d-b4a6-a4f1a5869a7e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:04.052576 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-377c187a-1a13-4c3d-b4a6-a4f1a5869a7e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:04.058598 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-377c187a-1a13-4c3d-b4a6-a4f1a5869a7e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:04.059075 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-377c187a-1a13-4c3d-b4a6-a4f1a5869a7e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:04.059835 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-377c187a-1a13-4c3d-b4a6-a4f1a5869a7e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:04.060269 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-377c187a-1a13-4c3d-b4a6-a4f1a5869a7e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:04.157118 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-377c187a-1a13-4c3d-b4a6-a4f1a5869a7e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109529 Jun 07 13:24:04.158453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 346/714] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Jun 7 13:24:04 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:04.454233 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-77571604-7f87-46f5-859b-4b9f4ee98c7f req-b1287355-4362-4006-aedf-624687c0a4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e44fbd-542f-491b-924a-b344febacc9e", "tag": "d6ca44d9-1b5d-4453-991d-603401049b3a"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:04.462754 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-77571604-7f87-46f5-859b-4b9f4ee98c7f req-b1287355-4362-4006-aedf-624687c0a4e0 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:04.463290 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-77571604-7f87-46f5-859b-4b9f4ee98c7f req-b1287355-4362-4006-aedf-624687c0a4e0 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:04.475189 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-77571604-7f87-46f5-859b-4b9f4ee98c7f req-b1287355-4362-4006-aedf-624687c0a4e0 service nova] Creating event network-changed:d6ca44d9-1b5d-4453-991d-603401049b3a for instance 64e44fbd-542f-491b-924a-b344febacc9e on hv-cinder-84460 Jun 07 13:24:04.481940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-77571604-7f87-46f5-859b-4b9f4ee98c7f req-b1287355-4362-4006-aedf-624687c0a4e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031482 Jun 07 13:24:04.483057 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 369/715] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:05.755041 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-6645cd8f-28ff-479c-a903-1081f4407bb1 req-350956ce-7d64-48fc-bdc2-ed8cbbb61875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5264ef-a5c4-498e-8c65-af627dcfa757", "tag": "1d4702b2-63b5-41cf-b9f0-f021d1576e6f"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:05.764106 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-6645cd8f-28ff-479c-a903-1081f4407bb1 req-350956ce-7d64-48fc-bdc2-ed8cbbb61875 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:05.764772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-6645cd8f-28ff-479c-a903-1081f4407bb1 req-350956ce-7d64-48fc-bdc2-ed8cbbb61875 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:05.776263 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-6645cd8f-28ff-479c-a903-1081f4407bb1 req-350956ce-7d64-48fc-bdc2-ed8cbbb61875 service nova] Creating event network-changed:1d4702b2-63b5-41cf-b9f0-f021d1576e6f for instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 on hv-cinder-84460 Jun 07 13:24:05.781242 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-6645cd8f-28ff-479c-a903-1081f4407bb1 req-350956ce-7d64-48fc-bdc2-ed8cbbb61875 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030379 Jun 07 13:24:05.781839 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 347/716] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:06.109717 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b9203991-fcf0-479d-868b-c6171e915707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:06.110333 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b9203991-fcf0-479d-868b-c6171e915707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:06.116536 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b9203991-fcf0-479d-868b-c6171e915707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.116915 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b9203991-fcf0-479d-868b-c6171e915707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.118232 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b9203991-fcf0-479d-868b-c6171e915707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.118672 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b9203991-fcf0-479d-868b-c6171e915707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.140949 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-b9203991-fcf0-479d-868b-c6171e915707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lazy-loading 'flavor' on Instance uuid c812d20c-e7fd-49b1-9813-91433ee35219 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:24:06.416757 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b9203991-fcf0-479d-868b-c6171e915707 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/action" status: 202 len: 0 microversion: 2.20 time: 0.312155 Jun 07 13:24:06.421755 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 370/717] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Jun 7 13:24:06 2022] POST /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:24:06.427452 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:06.429045 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:06.439258 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.439711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.440529 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:06.440955 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:06.584534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:06.594727 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:06.596845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:06.603027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-48abbfc2-f319-49df-b81e-c4e6b4889f29 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.175986 Jun 07 13:24:06.603968 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 348/718] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:06 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:07.622107 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:07.622801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:07.629123 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:07.629557 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:07.630320 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:07.630755 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:07.765529 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:07.773434 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:07.775539 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:07.776707 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f8856a68-6330-4e8a-b155-80cbfac8d229 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.158999 Jun 07 13:24:07.777265 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 371/719] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:07 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:08.794728 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:08.795363 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:08.801936 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:08.802388 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:08.803261 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:08.803701 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:08.929614 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:08.938001 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:08.939542 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:08.940707 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-61f5c250-13f4-47d5-be2a-7a4cfb4b199b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.149904 Jun 07 13:24:08.941279 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 349/720] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:08 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:09.959222 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:09.959831 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:09.966580 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:09.967059 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:09.967813 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:09.968245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:10.090701 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:10.098497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:10.100020 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:10.101173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-276f2138-36d9-42aa-8512-2bde584c7fda tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.145954 Jun 07 13:24:10.101734 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 372/721] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:09 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:11.119454 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:11.120066 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:11.126628 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:11.127110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:11.127872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:11.128305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:11.255408 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:11.263815 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:11.265366 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:11.266561 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-96f14e00-d892-4fb8-a83c-d3935691ca67 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.151157 Jun 07 13:24:11.267175 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 350/722] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:11 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:12.285266 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:12.285881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:12.292495 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:12.292941 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:12.293693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:12.294126 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:12.421680 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:12.429670 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:12.431200 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:12.432527 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7a61f087-4afa-4584-972b-22dcc2725954 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.151041 Jun 07 13:24:12.432901 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 373/723] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:12 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:13.450175 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:13.450786 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:13.457376 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:13.457827 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:13.458579 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:13.459054 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:13.587735 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:13.595632 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:13.597144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:13.598362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e9ed773f-4108-4fd8-acee-55f45b62ef73 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.152787 Jun 07 13:24:13.598946 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 351/724] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:13 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:14.616299 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:14.616910 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:14.623515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:14.623969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:14.624728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:14.625167 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:14.748670 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:14.756557 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:14.758060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:14.759855 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f9d5aa8c-ab26-4d37-92a8-559a2af53700 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.147452 Jun 07 13:24:14.760451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 374/725] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:14 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:15.778515 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:15.779151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:15.785818 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:15.786296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:15.787072 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:15.787504 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:15.913945 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:15.921890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:15.923435 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:15.924595 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f7e9aa56-44ce-4875-9844-fa0ff8017edd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.151056 Jun 07 13:24:15.925158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 352/726] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:15 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:16.942443 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:16.943099 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:16.949154 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:16.949610 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:16.950369 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:16.950807 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:17.263130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:17.270988 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:17.272500 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:17.273664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e0b0ea4f-36ec-418e-8e6a-a300bd9da7a5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.335093 Jun 07 13:24:17.274867 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 375/727] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:16 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:18.389102 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:18.389718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:18.395645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:18.396095 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:18.396857 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:18.397296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:18.522083 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:18.530573 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:18.532485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:18.533824 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cb036021-3178-4cbb-b65e-cc917aabdf6d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.245362 Jun 07 13:24:18.534385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 353/728] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:18 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:19.552546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:19.553161 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:19.559280 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:19.559736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:19.560496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:19.560937 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:19.687881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:19.695776 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:19.697787 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:19.698973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-963a14ae-a42c-4e9b-acdb-a85cd6c6de0a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.150440 Jun 07 13:24:19.699535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 376/729] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:19 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:20.716875 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:20.717493 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:20.724128 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:20.724582 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:20.725348 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:20.725791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:20.851286 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:20.854765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=100 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:20.860369 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:20.861856 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:20.863040 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a453c713-a044-425a-8cf2-9741e85520b2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.150077 Jun 07 13:24:20.863590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 354/730] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:20 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:21.882187 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:21.882799 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:21.885265 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=62 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:21.890758 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:21.891232 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:21.891993 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:21.892431 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.022797 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:22.031270 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:22.032774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:22.033928 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ae2afca6-cfa5-4db3-ab6e-4721e8e1e86b tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.155664 Jun 07 13:24:22.034490 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 377/731] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:21 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:23.051796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:23.052403 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:23.054755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=56 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:23.060176 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:23.060621 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:23.061373 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:23.061804 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:23.185066 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:23.192782 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:23.194315 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:23.195497 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-03760909-6ce2-4f30-81ef-27c663ed2098 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1744 microversion: 2.20 time: 0.147864 Jun 07 13:24:23.196052 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 355/732] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:23 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:24.213437 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:24.214050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:24.220612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:24.221174 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:24.221952 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:24.222576 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:24.361147 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:24.369617 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:24.371153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:24.372448 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-24d77ee4-e815-4332-ab80-d9a879fee5c5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1739 microversion: 2.20 time: 0.162859 Jun 07 13:24:24.373102 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 378/733] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:24 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:25.391222 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:25.392729 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:25.403844 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:25.407712 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:25.408736 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:25.409322 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:25.476733 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-1ad3a79d-589a-41f7-af5e-f39aca57ddd1 req-ce9c64f3-fd99-4e01-a4ed-5834a0bc0c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c812d20c-e7fd-49b1-9813-91433ee35219", "name": "network-vif-plugged", "status": "completed", "tag": "1df72142-8d3b-4965-899a-3271031c03d3"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:25.492743 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-1ad3a79d-589a-41f7-af5e-f39aca57ddd1 req-ce9c64f3-fd99-4e01-a4ed-5834a0bc0c12 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:25.493556 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-1ad3a79d-589a-41f7-af5e-f39aca57ddd1 req-ce9c64f3-fd99-4e01-a4ed-5834a0bc0c12 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:25.510702 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-1ad3a79d-589a-41f7-af5e-f39aca57ddd1 req-ce9c64f3-fd99-4e01-a4ed-5834a0bc0c12 service nova] Creating event network-vif-plugged:1df72142-8d3b-4965-899a-3271031c03d3 for instance c812d20c-e7fd-49b1-9813-91433ee35219 on hv-cinder-84460 Jun 07 13:24:25.518203 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-1ad3a79d-589a-41f7-af5e-f39aca57ddd1 req-ce9c64f3-fd99-4e01-a4ed-5834a0bc0c12 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046991 Jun 07 13:24:25.519875 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 379/734] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:25.600260 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:25.610148 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:25.612008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:25.613388 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-aa44fa24-b4a3-4885-afa2-6c1a848c3dd9 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1739 microversion: 2.20 time: 0.226395 Jun 07 13:24:25.614136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 356/735] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:25 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:26.632255 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:26.632958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:26.643070 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:26.643539 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:26.644405 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:26.644843 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:26.796628 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:26.804606 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:26.806622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:26.808761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4fb2d2c0-468a-4c9a-9263-03c3af9bac52 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1739 microversion: 2.20 time: 0.180723 Jun 07 13:24:26.818021 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 380/736] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:26 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:27.826550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:27.827375 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:27.833873 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:27.834333 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:27.835120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:27.837633 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:27.986513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:27.995571 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:27.997233 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:27.998402 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1c5d00e6-685f-4bef-bff0-820b0653cbc0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1739 microversion: 2.20 time: 0.175773 Jun 07 13:24:27.999292 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 357/737] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:27 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:29.016616 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:29.017720 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:29.023991 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:29.024929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:29.025697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:29.026131 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:29.166745 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:29.175205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:29.176767 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:29.177957 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-47e621da-ea0d-452f-aa2d-50cf00ef5119 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1739 microversion: 2.20 time: 0.165287 Jun 07 13:24:29.178809 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 381/738] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:29 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:30.195739 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:30.196375 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:30.202926 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:30.203375 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:30.204124 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:30.204557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:30.342539 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:30.350784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:30.352819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:30.354008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-260a2e58-dddc-494b-84e6-a5952d9a44b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1739 microversion: 2.20 time: 0.162157 Jun 07 13:24:30.354871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 358/739] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:30 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:31.372991 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:31.373605 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:31.379898 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:31.380352 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:31.383158 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:31.383158 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:31.528739 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:31.537619 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:31.539141 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:31.540834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-04961e99-3cf5-4552-917d-e66fee0db3a8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1739 microversion: 2.20 time: 0.171725 Jun 07 13:24:31.551606 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 382/740] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:31 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:32.560003 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:32.560758 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:32.567263 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:32.567876 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:32.568660 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:32.569096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:32.713835 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:32.722259 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:32.723801 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:32.724963 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-554184f7-da8b-4747-8ccf-91853fd6e7cf tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1739 microversion: 2.20 time: 0.170080 Jun 07 13:24:32.725755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 359/741] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:32 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:33.743565 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:33.744176 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:33.750092 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:33.750538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:33.751323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:33.751756 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:33.878162 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:33.880479 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:33.887999 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:33.889584 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:33.891141 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0cb60365-56b1-4dfa-bdc2-4e4962db21c8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1739 microversion: 2.20 time: 0.151399 Jun 07 13:24:33.891697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 383/742] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:33 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:34.909482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:34.910142 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:34.917369 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:34.917818 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:34.918577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:34.919048 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:35.042456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:35.050375 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:35.051911 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:35.053071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5c999113-6f67-418d-a05f-b525b67e93f2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1721 microversion: 2.20 time: 0.147552 Jun 07 13:24:35.053634 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 360/743] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:34 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:36.072451 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:36.073063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:36.080230 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:36.080682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:36.081438 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:36.081872 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:36.209464 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:36.217853 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:36.219364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:36.220512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-491f98d9-1261-4956-8093-24473c590aab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1721 microversion: 2.20 time: 0.153420 Jun 07 13:24:36.221082 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 384/744] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:36 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:37.238552 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:37.239195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:37.245691 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:37.246140 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:37.246931 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:37.247369 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:37.372509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:37.380482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:37.382147 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:37.383400 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-570ba166-58de-4b6c-b04c-ae5d8bc763f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1664 microversion: 2.20 time: 0.148755 Jun 07 13:24:37.383958 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 361/745] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:37 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:37.401826 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-120372bf-5120-40ca-86ff-7aa816c3c6d5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d73036d8-705f-47b9-aa93-d89fe2b991fc"}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:37.402905 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-120372bf-5120-40ca-86ff-7aa816c3c6d5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:37.408934 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-120372bf-5120-40ca-86ff-7aa816c3c6d5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:37.409384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-120372bf-5120-40ca-86ff-7aa816c3c6d5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:37.410144 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-120372bf-5120-40ca-86ff-7aa816c3c6d5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:37.410579 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-120372bf-5120-40ca-86ff-7aa816c3c6d5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:37.426807 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-7decb4f6-4eba-46e9-8824-f292faaa5a88 req-74b1188e-890b-4015-aad0-edbf7fd4ee3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c812d20c-e7fd-49b1-9813-91433ee35219", "name": "network-vif-unplugged", "status": "completed", "tag": "1df72142-8d3b-4965-899a-3271031c03d3"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:37.436012 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-7decb4f6-4eba-46e9-8824-f292faaa5a88 req-74b1188e-890b-4015-aad0-edbf7fd4ee3a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:37.436665 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-7decb4f6-4eba-46e9-8824-f292faaa5a88 req-74b1188e-890b-4015-aad0-edbf7fd4ee3a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:37.448391 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.compute.server_external_events [req-7decb4f6-4eba-46e9-8824-f292faaa5a88 req-74b1188e-890b-4015-aad0-edbf7fd4ee3a service nova] Unable to find a host for instance c812d20c-e7fd-49b1-9813-91433ee35219. Dropping event network-vif-unplugged {{(pid=117842) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 13:24:37.449285 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-7decb4f6-4eba-46e9-8824-f292faaa5a88 req-74b1188e-890b-4015-aad0-edbf7fd4ee3a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026608 Jun 07 13:24:37.449868 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 362/746] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 07 13:24:37.692979 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-120372bf-5120-40ca-86ff-7aa816c3c6d5 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295562 Jun 07 13:24:37.698014 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 385/747] 10.222.0.61 () {62 vars in 1363 bytes} [Tue Jun 7 13:24:37 2022] POST /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:24:37.804214 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9be1fbc5-96e3-49f3-a4c5-b0389112fa64 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:37.804710 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9be1fbc5-96e3-49f3-a4c5-b0389112fa64 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:37.810640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9be1fbc5-96e3-49f3-a4c5-b0389112fa64 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:37.811131 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9be1fbc5-96e3-49f3-a4c5-b0389112fa64 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:37.811886 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9be1fbc5-96e3-49f3-a4c5-b0389112fa64 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:37.812323 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9be1fbc5-96e3-49f3-a4c5-b0389112fa64 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:38.033838 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9be1fbc5-96e3-49f3-a4c5-b0389112fa64 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/os-volume_attachments/d73036d8-705f-47b9-aa93-d89fe2b991fc" status: 202 len: 0 microversion: 2.20 time: 0.233485 Jun 07 13:24:38.034454 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 363/748] 10.222.0.61 () {60 vars in 1456 bytes} [Tue Jun 7 13:24:37 2022] DELETE /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/os-volume_attachments/d73036d8-705f-47b9-aa93-d89fe2b991fc => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:24:38.088893 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8c55acc7-2eff-4d49-86e5-ec503b8fcc38 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:38.089496 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8c55acc7-2eff-4d49-86e5-ec503b8fcc38 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:38.095801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c55acc7-2eff-4d49-86e5-ec503b8fcc38 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:38.096257 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c55acc7-2eff-4d49-86e5-ec503b8fcc38 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:38.097022 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c55acc7-2eff-4d49-86e5-ec503b8fcc38 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:38.097460 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c55acc7-2eff-4d49-86e5-ec503b8fcc38 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:38.173516 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8c55acc7-2eff-4d49-86e5-ec503b8fcc38 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "POST /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/action" status: 202 len: 0 microversion: 2.20 time: 0.088780 Jun 07 13:24:38.174205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 386/749] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Jun 7 13:24:38 2022] POST /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:24:38.182807 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:38.183441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:38.189772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:38.190232 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:38.191032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:38.191469 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:38.324850 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:38.333392 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:38.334928 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:38.336102 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-84457a2c-1b79-4c0e-a51f-6088b53d42b0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1672 microversion: 2.20 time: 0.157780 Jun 07 13:24:38.336725 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 364/750] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:38 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:39.354068 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:39.354675 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:39.360862 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:39.361310 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:39.362076 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:39.362506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:39.492228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:39.500443 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:39.501953 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:39.503148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ddf2a9dc-ab41-4ed2-88d7-7d661866f3ce tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.153604 Jun 07 13:24:39.503923 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 387/751] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:39 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:40.521533 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:40.522146 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:40.528920 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:40.529279 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:40.530048 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:40.530487 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:40.665388 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:40.673336 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:40.674855 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:40.676027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0af315b9-88df-4276-af21-a22355c1d379 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.158456 Jun 07 13:24:40.676788 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 365/752] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:40 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:41.694291 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:41.695128 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:41.702205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:41.702871 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:41.703655 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:41.704088 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:41.839737 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:41.847631 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:41.849123 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:41.850290 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-4a03ed27-bf95-4841-9019-06c79c4b3f3d tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.160055 Jun 07 13:24:41.850867 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 388/753] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:41 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:42.869173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:42.869857 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:42.877408 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:42.879357 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:42.880471 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:42.881133 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:43.173682 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:43.182219 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:43.183780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:43.185107 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-76f91edf-e08a-4fcb-8e10-079a568027ed tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.320410 Jun 07 13:24:43.185668 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 366/754] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:42 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:44.203272 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:44.203825 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:44.209819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:44.210266 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:44.211049 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:44.211484 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:44.346942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:44.357795 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:44.357795 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:44.358555 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-29bf8237-b65b-43be-b61c-786a3255e9ca tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.158972 Jun 07 13:24:44.359196 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 389/755] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:44 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:45.377206 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:45.378141 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:45.384832 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:45.385238 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:45.386035 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:45.386394 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:45.523227 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:45.531568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:45.533070 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:45.534226 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-112b8c38-7fa0-4a57-9af3-044e9b2f1e33 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.161025 Jun 07 13:24:45.534782 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 367/756] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:45 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:24:46.552906 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:46.553523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:46.559668 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:46.560113 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:46.560871 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:46.561309 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:46.756885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:46.766385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:46.768091 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:46.769596 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-95173938-e20e-46af-89a8-972e3fce94ba tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.220542 Jun 07 13:24:46.770512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 390/757] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:46 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:46.996534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-94115d45-6557-423b-90b1-e82ff020215f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:46.997383 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-94115d45-6557-423b-90b1-e82ff020215f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:47.003163 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94115d45-6557-423b-90b1-e82ff020215f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:47.003616 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94115d45-6557-423b-90b1-e82ff020215f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:47.004455 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94115d45-6557-423b-90b1-e82ff020215f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:47.004837 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-94115d45-6557-423b-90b1-e82ff020215f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:47.029199 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-94115d45-6557-423b-90b1-e82ff020215f tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/ips" status: 200 len: 151 microversion: 2.1 time: 0.037158 Jun 07 13:24:47.029971 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 368/758] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:24:46 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:47.788704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:47.789444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:47.796381 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:47.796846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:47.797619 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:47.798068 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:47.937242 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:47.945280 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:47.946924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:47.948178 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-cc743208-7080-4bbf-92d4-a796b40848fb tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.163476 Jun 07 13:24:47.949058 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 391/759] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:47 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:48.391756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3c25683d-91a5-4912-8b66-286e235871a9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a01f41f-9221-4165-8e0b-cb73751c4492"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:48.392886 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3c25683d-91a5-4912-8b66-286e235871a9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:48.399662 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3c25683d-91a5-4912-8b66-286e235871a9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:48.400056 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3c25683d-91a5-4912-8b66-286e235871a9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:48.400827 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3c25683d-91a5-4912-8b66-286e235871a9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:48.401256 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3c25683d-91a5-4912-8b66-286e235871a9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:48.966152 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:48.966711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:48.972764 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:48.973215 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:48.974105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:48.974546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:49.107370 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:49.115797 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:49.117289 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:49.118983 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2f65e16c-7da3-4661-beec-c56878bc0cc2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.157433 Jun 07 13:24:49.119527 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 392/760] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:48 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:24:50.136860 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:50.137483 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:50.143469 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:50.143915 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:50.144711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:50.145166 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:50.278878 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:50.286707 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:50.288305 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:50.289456 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8bf0839f-7755-4d10-bf03-db5f64ffb0e2 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.156455 Jun 07 13:24:50.290008 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 393/761] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:50 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:24:50.510234 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:50.620576 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3c25683d-91a5-4912-8b66-286e235871a9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "POST /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.233339 Jun 07 13:24:50.621143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 369/762] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:24:48 2022] POST /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments => generated 194 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:51.309214 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:51.309877 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:51.316273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:51.316677 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:51.317447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:51.318769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:51.449362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:51.457411 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:51.459019 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:51.460216 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fde1a881-c373-40fd-97c9-dbddaf9db9f0 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.155479 Jun 07 13:24:51.460771 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 394/763] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:51 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:52.479155 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:52.479857 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:52.486343 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:52.486790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:52.487572 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:52.488009 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:52.563349 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-457ddf38-344e-4986-8cd2-8c23fe18fef9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:52.563909 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-457ddf38-344e-4986-8cd2-8c23fe18fef9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:52.565742 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=38 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:52.571298 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-457ddf38-344e-4986-8cd2-8c23fe18fef9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:52.572245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-457ddf38-344e-4986-8cd2-8c23fe18fef9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:52.573016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-457ddf38-344e-4986-8cd2-8c23fe18fef9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:52.573458 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-457ddf38-344e-4986-8cd2-8c23fe18fef9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:52.596950 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-457ddf38-344e-4986-8cd2-8c23fe18fef9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/ips" status: 200 len: 144 microversion: 2.1 time: 0.037714 Jun 07 13:24:52.597519 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 395/764] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:24:52 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:24:52.620549 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:52.628413 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:52.629938 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:52.631118 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7b6b5b82-7bf0-47a7-9d68-c40aa6dc36b8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.157394 Jun 07 13:24:52.631668 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 370/765] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:52 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:53.564293 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-2f38eadd-51b4-4ed1-8787-99e5ef6ba15f req-e2c2b93f-5fd1-4972-acef-99c4f73cabcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c812d20c-e7fd-49b1-9813-91433ee35219", "name": "network-vif-plugged", "status": "completed", "tag": "1df72142-8d3b-4965-899a-3271031c03d3"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:53.572411 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-2f38eadd-51b4-4ed1-8787-99e5ef6ba15f req-e2c2b93f-5fd1-4972-acef-99c4f73cabcb service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:53.572940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-2f38eadd-51b4-4ed1-8787-99e5ef6ba15f req-e2c2b93f-5fd1-4972-acef-99c4f73cabcb service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:53.583922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-2f38eadd-51b4-4ed1-8787-99e5ef6ba15f req-e2c2b93f-5fd1-4972-acef-99c4f73cabcb service nova] Creating event network-vif-plugged:1df72142-8d3b-4965-899a-3271031c03d3 for instance c812d20c-e7fd-49b1-9813-91433ee35219 on hv-cinder-84460 Jun 07 13:24:53.588795 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-2f38eadd-51b4-4ed1-8787-99e5ef6ba15f req-e2c2b93f-5fd1-4972-acef-99c4f73cabcb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028142 Jun 07 13:24:53.589673 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 396/766] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:53.650018 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:53.650783 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:53.653026 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=32 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:53.658722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:53.659202 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:53.659971 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:53.660410 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:53.788689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:53.797590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:53.799314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:53.800606 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a0a0dda6-e305-4f91-9389-427d2224aebd tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.155127 Jun 07 13:24:53.801273 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 371/767] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:53 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:54.819945 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:54.820783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:54.827966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:54.828508 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:54.829362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:54.829874 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:54.969640 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:54.972410 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:54.980018 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:54.981512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:54.982708 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-995a0e72-3ac1-4538-8023-9bee9983d9be tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.167239 Jun 07 13:24:54.983297 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 397/768] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:54 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:55.717692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-18fb123f-41c2-4409-af6e-702cb5833d33 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd122157-138e-4b91-9ba4-a6d40b95a8c1"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:55.719721 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-18fb123f-41c2-4409-af6e-702cb5833d33 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:55.726467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-18fb123f-41c2-4409-af6e-702cb5833d33 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:55.726776 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-18fb123f-41c2-4409-af6e-702cb5833d33 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:55.727588 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-18fb123f-41c2-4409-af6e-702cb5833d33 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:55.728111 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-18fb123f-41c2-4409-af6e-702cb5833d33 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:55.987174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-18fb123f-41c2-4409-af6e-702cb5833d33 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273503 Jun 07 13:24:55.992781 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 372/769] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:24:55 2022] POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:56.002542 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:56.003984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:56.011344 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:56.012107 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:56.012895 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:56.013366 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:56.152567 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:56.160473 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:56.161984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:56.163172 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-829edab9-b881-42e3-9ed1-f2d236d0b339 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1730 microversion: 2.20 time: 0.166276 Jun 07 13:24:56.163741 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 398/770] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:55 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:57.182520 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:57.183233 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:57.189974 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:57.190421 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:57.191304 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:57.191737 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:57.316241 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:57.325790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:57.327310 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:57.328461 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b740a581-accd-455d-965f-f6e102373636 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1717 microversion: 2.20 time: 0.150170 Jun 07 13:24:57.329009 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 373/771] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:24:57 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1717 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:24:58.221628 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fd661940-4afd-499f-a7d4-33beffb54fc9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:58.222140 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fd661940-4afd-499f-a7d4-33beffb54fc9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:58.228180 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd661940-4afd-499f-a7d4-33beffb54fc9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:58.229276 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd661940-4afd-499f-a7d4-33beffb54fc9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:58.230041 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd661940-4afd-499f-a7d4-33beffb54fc9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:58.230497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fd661940-4afd-499f-a7d4-33beffb54fc9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:58.309210 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-fd661940-4afd-499f-a7d4-33beffb54fc9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lazy-loading 'services' on Instance uuid f885ff03-d893-4004-9674-c64cc19f2ace {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:24:58.378725 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fd661940-4afd-499f-a7d4-33beffb54fc9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments/1a01f41f-9221-4165-8e0b-cb73751c4492" status: 202 len: 0 microversion: 2.1 time: 0.161112 Jun 07 13:24:58.379578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 399/772] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:24:58 2022] DELETE /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments/1a01f41f-9221-4165-8e0b-cb73751c4492 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:24:58.387728 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0b425c43-7972-4be9-aa1e-15fb9c1cb4d0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:58.388775 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0b425c43-7972-4be9-aa1e-15fb9c1cb4d0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:58.395079 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0b425c43-7972-4be9-aa1e-15fb9c1cb4d0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:58.395656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0b425c43-7972-4be9-aa1e-15fb9c1cb4d0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:58.396596 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0b425c43-7972-4be9-aa1e-15fb9c1cb4d0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:58.397085 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0b425c43-7972-4be9-aa1e-15fb9c1cb4d0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:58.433266 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0b425c43-7972-4be9-aa1e-15fb9c1cb4d0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049485 Jun 07 13:24:58.433829 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 374/773] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:24:58 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:59.445546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-109bed2d-7b52-40b4-925c-943872f92052 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:59.446618 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-109bed2d-7b52-40b4-925c-943872f92052 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:59.452966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-109bed2d-7b52-40b4-925c-943872f92052 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:59.453421 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-109bed2d-7b52-40b4-925c-943872f92052 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:59.454183 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-109bed2d-7b52-40b4-925c-943872f92052 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:59.454621 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-109bed2d-7b52-40b4-925c-943872f92052 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:59.484366 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-109bed2d-7b52-40b4-925c-943872f92052 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Jun 07 13:24:59.484911 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 400/774] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:24:59 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:00.496781 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3b345dac-8ce6-480e-b9d2-62ee8cb816d2 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:00.497743 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3b345dac-8ce6-480e-b9d2-62ee8cb816d2 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:00.504333 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b345dac-8ce6-480e-b9d2-62ee8cb816d2 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.504768 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b345dac-8ce6-480e-b9d2-62ee8cb816d2 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.505531 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b345dac-8ce6-480e-b9d2-62ee8cb816d2 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:00.505967 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3b345dac-8ce6-480e-b9d2-62ee8cb816d2 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:00.534615 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3b345dac-8ce6-480e-b9d2-62ee8cb816d2 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Jun 07 13:25:00.535210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 375/775] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:25:00 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:01.546356 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b7d17506-3d8c-4db2-b66d-cca4709ece81 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:01.547276 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b7d17506-3d8c-4db2-b66d-cca4709ece81 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:01.553365 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b7d17506-3d8c-4db2-b66d-cca4709ece81 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:01.553819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b7d17506-3d8c-4db2-b66d-cca4709ece81 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:01.554582 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b7d17506-3d8c-4db2-b66d-cca4709ece81 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:01.555058 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b7d17506-3d8c-4db2-b66d-cca4709ece81 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:01.583068 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b7d17506-3d8c-4db2-b66d-cca4709ece81 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040866 Jun 07 13:25:01.583608 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 401/776] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:25:01 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:02.595046 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-29940cc9-be2f-4682-bd68-9241731ef3b9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:02.595925 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-29940cc9-be2f-4682-bd68-9241731ef3b9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:02.602565 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-29940cc9-be2f-4682-bd68-9241731ef3b9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:02.603078 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-29940cc9-be2f-4682-bd68-9241731ef3b9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:02.604433 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-29940cc9-be2f-4682-bd68-9241731ef3b9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:02.604872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-29940cc9-be2f-4682-bd68-9241731ef3b9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:02.633104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-29940cc9-be2f-4682-bd68-9241731ef3b9 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Jun 07 13:25:02.633648 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 376/777] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:25:02 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:03.491368 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-156b9390-cfda-4159-b986-dc552c8322e5 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:03.497925 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-156b9390-cfda-4159-b986-dc552c8322e5 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.498379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-156b9390-cfda-4159-b986-dc552c8322e5 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.555820 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-156b9390-cfda-4159-b986-dc552c8322e5 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Going to try to stop instance {{(pid=117843) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 13:25:03.596982 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-156b9390-cfda-4159-b986-dc552c8322e5 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/action" status: 202 len: 0 microversion: 2.1 time: 0.109113 Jun 07 13:25:03.597505 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 402/778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:25:03 2022] POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:25:03.605431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2683232d-d375-49da-9c28-e5fabf8cd6e3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:03.606049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2683232d-d375-49da-9c28-e5fabf8cd6e3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:03.613010 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2683232d-d375-49da-9c28-e5fabf8cd6e3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.613469 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2683232d-d375-49da-9c28-e5fabf8cd6e3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.614223 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2683232d-d375-49da-9c28-e5fabf8cd6e3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.614660 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2683232d-d375-49da-9c28-e5fabf8cd6e3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.645228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-60a96fcd-40c2-4635-be0a-9ea9da574c90 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:03.646315 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-60a96fcd-40c2-4635-be0a-9ea9da574c90 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:03.652712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-60a96fcd-40c2-4635-be0a-9ea9da574c90 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.653169 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-60a96fcd-40c2-4635-be0a-9ea9da574c90 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.653937 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-60a96fcd-40c2-4635-be0a-9ea9da574c90 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:03.654373 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-60a96fcd-40c2-4635-be0a-9ea9da574c90 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:03.690735 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-60a96fcd-40c2-4635-be0a-9ea9da574c90 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049656 Jun 07 13:25:03.691359 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 403/779] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:25:03 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:25:03.755069 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2683232d-d375-49da-9c28-e5fabf8cd6e3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:03.763108 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2683232d-d375-49da-9c28-e5fabf8cd6e3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1720 microversion: 2.1 time: 0.161448 Jun 07 13:25:03.763696 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 377/780] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:03 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:04.702851 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-41733035-f661-47fd-a48d-722282852df0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:04.703786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-41733035-f661-47fd-a48d-722282852df0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:04.709920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-41733035-f661-47fd-a48d-722282852df0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.710371 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-41733035-f661-47fd-a48d-722282852df0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.711166 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-41733035-f661-47fd-a48d-722282852df0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.711601 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-41733035-f661-47fd-a48d-722282852df0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.739488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-41733035-f661-47fd-a48d-722282852df0 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040682 Jun 07 13:25:04.740029 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 404/781] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:25:04 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:25:04.780884 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a6d652ab-5ce5-4b22-a8c7-4f8d3598977a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:04.781622 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a6d652ab-5ce5-4b22-a8c7-4f8d3598977a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:04.788314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6d652ab-5ce5-4b22-a8c7-4f8d3598977a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.788769 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6d652ab-5ce5-4b22-a8c7-4f8d3598977a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.789648 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6d652ab-5ce5-4b22-a8c7-4f8d3598977a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.790085 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a6d652ab-5ce5-4b22-a8c7-4f8d3598977a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.796468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-615b847e-9fe9-4ff5-bf61-1071b5fb43ff tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:04.797039 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-615b847e-9fe9-4ff5-bf61-1071b5fb43ff tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:04.803174 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-615b847e-9fe9-4ff5-bf61-1071b5fb43ff tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.803635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-615b847e-9fe9-4ff5-bf61-1071b5fb43ff tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.804442 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-615b847e-9fe9-4ff5-bf61-1071b5fb43ff tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.804879 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-615b847e-9fe9-4ff5-bf61-1071b5fb43ff tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.829324 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-615b847e-9fe9-4ff5-bf61-1071b5fb43ff tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:25:04.905215 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-615b847e-9fe9-4ff5-bf61-1071b5fb43ff tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 204 len: 0 microversion: 2.1 time: 0.112379 Jun 07 13:25:04.906437 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 405/782] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:04 2022] DELETE /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:25:04.915181 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ea66f31b-8f3d-4de0-bfbf-56fd6508b613 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:04.915914 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ea66f31b-8f3d-4de0-bfbf-56fd6508b613 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:04.920199 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a6d652ab-5ce5-4b22-a8c7-4f8d3598977a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:04.921961 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ea66f31b-8f3d-4de0-bfbf-56fd6508b613 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.922419 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ea66f31b-8f3d-4de0-bfbf-56fd6508b613 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.923376 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ea66f31b-8f3d-4de0-bfbf-56fd6508b613 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:04.923826 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ea66f31b-8f3d-4de0-bfbf-56fd6508b613 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:04.928427 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a6d652ab-5ce5-4b22-a8c7-4f8d3598977a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1720 microversion: 2.1 time: 0.151412 Jun 07 13:25:04.929071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 378/783] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:04 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:05.050382 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ea66f31b-8f3d-4de0-bfbf-56fd6508b613 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:05.058275 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ea66f31b-8f3d-4de0-bfbf-56fd6508b613 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1682 microversion: 2.1 time: 0.147355 Jun 07 13:25:05.058911 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 406/784] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:04 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:25:05.945416 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c31b9232-1e35-447c-8d45-d849481c7884 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:05.946023 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c31b9232-1e35-447c-8d45-d849481c7884 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:05.953111 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c31b9232-1e35-447c-8d45-d849481c7884 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:05.953559 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c31b9232-1e35-447c-8d45-d849481c7884 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:05.954344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c31b9232-1e35-447c-8d45-d849481c7884 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:05.954782 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c31b9232-1e35-447c-8d45-d849481c7884 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:06.075086 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-55cd8d69-8806-4a74-bafd-bc8a9cc08ae1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:06.075710 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-55cd8d69-8806-4a74-bafd-bc8a9cc08ae1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:06.081684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55cd8d69-8806-4a74-bafd-bc8a9cc08ae1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:06.082136 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55cd8d69-8806-4a74-bafd-bc8a9cc08ae1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:06.082933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55cd8d69-8806-4a74-bafd-bc8a9cc08ae1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:06.083379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55cd8d69-8806-4a74-bafd-bc8a9cc08ae1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:06.084279 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c31b9232-1e35-447c-8d45-d849481c7884 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:06.092846 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c31b9232-1e35-447c-8d45-d849481c7884 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1720 microversion: 2.1 time: 0.151312 Jun 07 13:25:06.093423 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 379/785] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:05 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:06.207394 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-55cd8d69-8806-4a74-bafd-bc8a9cc08ae1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:06.215622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-55cd8d69-8806-4a74-bafd-bc8a9cc08ae1 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1682 microversion: 2.1 time: 0.144884 Jun 07 13:25:06.216193 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 407/786] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:06 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:07.111221 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1214b28f-477f-4acd-ba0e-93254df1b689 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:07.111827 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1214b28f-477f-4acd-ba0e-93254df1b689 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:07.120659 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1214b28f-477f-4acd-ba0e-93254df1b689 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.121114 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1214b28f-477f-4acd-ba0e-93254df1b689 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.122092 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1214b28f-477f-4acd-ba0e-93254df1b689 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.122530 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1214b28f-477f-4acd-ba0e-93254df1b689 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.233513 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a21f9c20-7f84-4179-86de-f543a1e8cc9c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:07.235673 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a21f9c20-7f84-4179-86de-f543a1e8cc9c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:07.242371 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a21f9c20-7f84-4179-86de-f543a1e8cc9c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.242936 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a21f9c20-7f84-4179-86de-f543a1e8cc9c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.243942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a21f9c20-7f84-4179-86de-f543a1e8cc9c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.244644 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a21f9c20-7f84-4179-86de-f543a1e8cc9c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.274140 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1214b28f-477f-4acd-ba0e-93254df1b689 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:07.285542 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1214b28f-477f-4acd-ba0e-93254df1b689 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1720 microversion: 2.1 time: 0.178540 Jun 07 13:25:07.287098 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 380/787] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:07 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:07.395194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a21f9c20-7f84-4179-86de-f543a1e8cc9c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:07.402920 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a21f9c20-7f84-4179-86de-f543a1e8cc9c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1682 microversion: 2.1 time: 0.174010 Jun 07 13:25:07.403498 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 408/788] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:07 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:07.912722 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-54a01399-704d-464d-bd19-fbdab9915eb6 req-935d533c-6999-4613-8058-4a67735cf554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f885ff03-d893-4004-9674-c64cc19f2ace", "name": "network-vif-deleted", "tag": "cbc5aa4d-f9b4-4263-a137-129218b1ded5"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:07.923237 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-54a01399-704d-464d-bd19-fbdab9915eb6 req-935d533c-6999-4613-8058-4a67735cf554 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:07.923765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-54a01399-704d-464d-bd19-fbdab9915eb6 req-935d533c-6999-4613-8058-4a67735cf554 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:07.935864 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-54a01399-704d-464d-bd19-fbdab9915eb6 req-935d533c-6999-4613-8058-4a67735cf554 service nova] Creating event network-vif-deleted:cbc5aa4d-f9b4-4263-a137-129218b1ded5 for instance f885ff03-d893-4004-9674-c64cc19f2ace on hv-cinder-84460 Jun 07 13:25:07.940931 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-54a01399-704d-464d-bd19-fbdab9915eb6 req-935d533c-6999-4613-8058-4a67735cf554 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032739 Jun 07 13:25:07.941822 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 381/789] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:08.303991 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ac82f823-6e70-443b-b630-df59b85f2492 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:08.304910 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ac82f823-6e70-443b-b630-df59b85f2492 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:08.311970 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ac82f823-6e70-443b-b630-df59b85f2492 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:08.312492 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ac82f823-6e70-443b-b630-df59b85f2492 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:08.313441 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ac82f823-6e70-443b-b630-df59b85f2492 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:08.313910 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ac82f823-6e70-443b-b630-df59b85f2492 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:08.421712 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:08.422419 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:08.438200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:08.438708 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:08.439537 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:08.440144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:08.472888 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ac82f823-6e70-443b-b630-df59b85f2492 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:08.478043 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:08.480106 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:08.480822 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lazy-loading 'fault' on Instance uuid f885ff03-d893-4004-9674-c64cc19f2ace {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:25:08.481896 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ac82f823-6e70-443b-b630-df59b85f2492 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1720 microversion: 2.1 time: 0.181906 Jun 07 13:25:08.491645 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 409/790] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:08 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:08.522677 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c60c4956f8479fbfe93f9f85a8d497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec73e3d0e6f8476d81463ea6e11b62cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:08.529662 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-dc878a8d-2cc7-45dc-b5e3-5becd58aca6a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 200 len: 1331 microversion: 2.1 time: 0.112395 Jun 07 13:25:08.530238 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 382/791] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:08 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:09.499600 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1b41ee59-99fc-462b-a1c5-a0466b5fa75d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:09.500218 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1b41ee59-99fc-462b-a1c5-a0466b5fa75d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:09.506212 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1b41ee59-99fc-462b-a1c5-a0466b5fa75d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:09.506667 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1b41ee59-99fc-462b-a1c5-a0466b5fa75d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:09.507487 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1b41ee59-99fc-462b-a1c5-a0466b5fa75d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:09.507928 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1b41ee59-99fc-462b-a1c5-a0466b5fa75d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:09.546795 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:09.547433 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:09.553877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:09.554329 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:09.555127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:09.555561 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:09.569387 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace HTTP/1.1 Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:25:09.571071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:09.572502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': 'f885ff03-d893-4004-9674-c64cc19f2ace'} Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:09.573845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:09.575129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:09.576254 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:09.576254 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d32bdf81-08fd-4bf2-914c-491123f51f56 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 404 len: 111 microversion: 2.1 time: 0.029490 Jun 07 13:25:09.576254 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 383/792] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:09 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:25:09.581915 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-07eebd8e-4e50-4c6a-a6ac-f74e32300253 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '.version_select at 0x7f46a369b5e0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:09.599629 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-07eebd8e-4e50-4c6a-a6ac-f74e32300253 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716070782" status: 202 len: 0 microversion: 2.1 time: 0.021324 Jun 07 13:25:09.600203 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 384/793] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Jun 7 13:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716070782 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:25:09.636081 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1b41ee59-99fc-462b-a1c5-a0466b5fa75d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:09.644009 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1b41ee59-99fc-462b-a1c5-a0466b5fa75d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1720 microversion: 2.1 time: 0.148208 Jun 07 13:25:09.644586 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 410/794] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:09 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:10.661156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-02c7a662-b7c1-44e3-a525-cb5f82286890 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:10.661773 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-02c7a662-b7c1-44e3-a525-cb5f82286890 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:10.668439 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-02c7a662-b7c1-44e3-a525-cb5f82286890 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:10.668895 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-02c7a662-b7c1-44e3-a525-cb5f82286890 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:10.669678 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-02c7a662-b7c1-44e3-a525-cb5f82286890 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:10.670115 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-02c7a662-b7c1-44e3-a525-cb5f82286890 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:10.796603 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-02c7a662-b7c1-44e3-a525-cb5f82286890 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:10.805176 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-02c7a662-b7c1-44e3-a525-cb5f82286890 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1720 microversion: 2.1 time: 0.148395 Jun 07 13:25:10.812437 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 385/795] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:10 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:11.348071 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:11.348562 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:11.355208 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:11.355666 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:11.356428 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:11.356875 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:11.361078 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:11.372123 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: DELETE /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace HTTP/1.1 Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:25:11.373823 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.375360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': 'f885ff03-d893-4004-9674-c64cc19f2ace'} Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:11.376194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.377578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.379037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:11.379037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-62014210-09e6-4d36-885e-1dcdd60a01b5 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 404 len: 111 microversion: 2.1 time: 0.031032 Jun 07 13:25:11.379037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 411/796] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:11 2022] DELETE /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:11.383488 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:11.384101 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: f885ff03-d893-4004-9674-c64cc19f2ace] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:11.390109 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:11.390552 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:11.391331 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:11.391763 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:11.394355 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:11.406597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace HTTP/1.1 Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:25:11.408174 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.409683 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': 'f885ff03-d893-4004-9674-c64cc19f2ace'} Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:11.410557 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. Jun 07 13:25:11.412110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:11.413459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance f885ff03-d893-4004-9674-c64cc19f2ace could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:11.413459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a4d78f81-8220-4494-b2b1-b9d8b3fa9a1c tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace" status: 404 len: 111 microversion: 2.1 time: 0.029861 Jun 07 13:25:11.413459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 386/797] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:11 2022] GET /compute/v2.1/servers/f885ff03-d893-4004-9674-c64cc19f2ace => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:11.821817 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e5240846-dd5a-4c18-98eb-0636a1aaf2f6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:11.822465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e5240846-dd5a-4c18-98eb-0636a1aaf2f6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:11.829368 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e5240846-dd5a-4c18-98eb-0636a1aaf2f6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:11.829821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e5240846-dd5a-4c18-98eb-0636a1aaf2f6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:11.830581 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e5240846-dd5a-4c18-98eb-0636a1aaf2f6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:11.831045 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e5240846-dd5a-4c18-98eb-0636a1aaf2f6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:11.956576 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e5240846-dd5a-4c18-98eb-0636a1aaf2f6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:11.965229 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e5240846-dd5a-4c18-98eb-0636a1aaf2f6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1720 microversion: 2.1 time: 0.147710 Jun 07 13:25:11.965788 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 412/798] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:11 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:12.541822 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:12.542338 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:12.549044 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.549493 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.550249 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.550680 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.564317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 HTTP/1.1 Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:25:12.565848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.567361 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '0ce009cf-5ec7-48ea-98dd-9488421317c2'} Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:12.568311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.569689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.571117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:12.571117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-caa93c44-ac33-4f04-a9b3-1a3ad2d2cf97 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 404 len: 111 microversion: 2.1 time: 0.029541 Jun 07 13:25:12.571117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 387/799] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:12 2022] DELETE /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:12.576175 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:12.576793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 0ce009cf-5ec7-48ea-98dd-9488421317c2] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:12.584045 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.584497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.585260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.585697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.598578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 HTTP/1.1 Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:25:12.600153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.601665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '0ce009cf-5ec7-48ea-98dd-9488421317c2'} Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:12.602538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. Jun 07 13:25:12.603967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.605379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance 0ce009cf-5ec7-48ea-98dd-9488421317c2 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:12.605379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fc546791-b4a2-42f5-aa5f-88e2e9df289e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2" status: 404 len: 111 microversion: 2.1 time: 0.029853 Jun 07 13:25:12.605379 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 413/800] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:12 2022] GET /compute/v2.1/servers/0ce009cf-5ec7-48ea-98dd-9488421317c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:12.609856 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:12.610348 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:12.616443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.616890 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.617638 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.618069 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.631606 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 HTTP/1.1 Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:25:12.633120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.634640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '20833de2-a8ed-47e0-a402-7d2c367a5fe5'} Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:12.636151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.637550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.639062 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:12.639062 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e86351ad-5bb2-48a5-8ae4-fcc9c807786e tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 404 len: 111 microversion: 2.1 time: 0.028625 Jun 07 13:25:12.639062 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 388/801] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:12 2022] DELETE /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:12.643623 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:12.644239 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 20833de2-a8ed-47e0-a402-7d2c367a5fe5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:12.650148 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.650596 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.651437 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.651874 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.665130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 HTTP/1.1 Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:25:12.666664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.668186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '20833de2-a8ed-47e0-a402-7d2c367a5fe5'} Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:12.669468 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. Jun 07 13:25:12.670931 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:12.672246 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance 20833de2-a8ed-47e0-a402-7d2c367a5fe5 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:12.672246 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-14b7b31c-1f83-4438-93b2-507cbebb1729 tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5" status: 404 len: 111 microversion: 2.1 time: 0.028321 Jun 07 13:25:12.672246 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 414/802] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:12 2022] GET /compute/v2.1/servers/20833de2-a8ed-47e0-a402-7d2c367a5fe5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:12.983229 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-67dbbafb-feb0-4727-98e6-ca27a8693b4b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:12.983849 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-67dbbafb-feb0-4727-98e6-ca27a8693b4b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:12.990148 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-67dbbafb-feb0-4727-98e6-ca27a8693b4b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.990600 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-67dbbafb-feb0-4727-98e6-ca27a8693b4b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:12.991396 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-67dbbafb-feb0-4727-98e6-ca27a8693b4b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:12.991831 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-67dbbafb-feb0-4727-98e6-ca27a8693b4b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.119963 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-67dbbafb-feb0-4727-98e6-ca27a8693b4b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:13.127879 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-67dbbafb-feb0-4727-98e6-ca27a8693b4b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1720 microversion: 2.1 time: 0.149276 Jun 07 13:25:13.128429 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 389/803] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:12 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:13.797203 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:13.797708 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:13.803786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.804237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.805026 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.805452 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.818454 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: DELETE /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e HTTP/1.1 Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:25:13.820061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.821697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '1184d0bc-4e76-42ed-8a67-6df8ce452b2e'} Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:13.822515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.824355 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.825895 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:13.825895 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-cd383613-ce3e-4346-8c2a-afae8eb27a4a tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 404 len: 111 microversion: 2.1 time: 0.028070 Jun 07 13:25:13.825895 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 415/804] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:13 2022] DELETE /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:13.830027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:13.830643 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] [instance: 1184d0bc-4e76-42ed-8a67-6df8ce452b2e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:13.837117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.837571 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.839047 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:13.839462 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:13.856517 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] HTTP exception thrown: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Request method failure captured: Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e HTTP/1.1 Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1ARuJjCol15JqUgWEwjh7pF0dlkn6gOrCg_A5M-BGPAiWLmsfmMhjzjCqFdJV0DR22ZwjV6yW8jz34x4QBVytzaxvpc214K8XTKNF296cv4c2YIiAz3_lBVQg6pNPYZj-Oy-YQWatJeZhKhpIyYy2SGABqQ6MRYWmzBxNnq_WRNn60 Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:25:13.858033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec73e3d0e6f8476d81463ea6e11b62cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: ec73e3d0e6f8476d81463ea6e11b62cd Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604660548 Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 49c60c4956f8479fbfe93f9f85a8d497 Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeNegativeTest-604660548-project Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.859899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '1184d0bc-4e76-42ed-8a67-6df8ce452b2e'} Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:13.860780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. Jun 07 13:25:13.862200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:13.863525 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] Returning 404 to user: Instance 1184d0bc-4e76-42ed-8a67-6df8ce452b2e could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:13.863525 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-14f6c537-ab44-4b9c-b6a8-6a93958201bc tempest-AttachVolumeNegativeTest-604660548 tempest-AttachVolumeNegativeTest-604660548-project] 10.222.0.61 "GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e" status: 404 len: 111 microversion: 2.1 time: 0.033548 Jun 07 13:25:13.863525 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 390/805] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:13 2022] GET /compute/v2.1/servers/1184d0bc-4e76-42ed-8a67-6df8ce452b2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:25:14.145341 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-472490e9-2603-4dbc-9c5b-7c711fe56306 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:14.145980 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-472490e9-2603-4dbc-9c5b-7c711fe56306 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:14.151890 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-472490e9-2603-4dbc-9c5b-7c711fe56306 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.152343 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-472490e9-2603-4dbc-9c5b-7c711fe56306 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.153107 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-472490e9-2603-4dbc-9c5b-7c711fe56306 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.153551 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-472490e9-2603-4dbc-9c5b-7c711fe56306 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.591162 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-472490e9-2603-4dbc-9c5b-7c711fe56306 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:14.600289 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-472490e9-2603-4dbc-9c5b-7c711fe56306 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1697 microversion: 2.1 time: 0.458935 Jun 07 13:25:14.600854 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 416/806] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:14 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1697 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:14.617389 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c2d2c16e-6c10-49e5-bd7e-968d337544e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:14.623447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c2d2c16e-6c10-49e5-bd7e-968d337544e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.623904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c2d2c16e-6c10-49e5-bd7e-968d337544e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.683371 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c2d2c16e-6c10-49e5-bd7e-968d337544e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Going to try to start instance {{(pid=117842) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 13:25:14.725268 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c2d2c16e-6c10-49e5-bd7e-968d337544e9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/action" status: 202 len: 0 microversion: 2.1 time: 0.111544 Jun 07 13:25:14.725887 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 391/807] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:25:14 2022] POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:25:14.734630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-541a2bf4-e23a-40d1-a8c9-441449f64087 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:14.735278 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-541a2bf4-e23a-40d1-a8c9-441449f64087 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:14.741530 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-541a2bf4-e23a-40d1-a8c9-441449f64087 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.742018 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-541a2bf4-e23a-40d1-a8c9-441449f64087 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.742899 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-541a2bf4-e23a-40d1-a8c9-441449f64087 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:14.743362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-541a2bf4-e23a-40d1-a8c9-441449f64087 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:14.957556 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-541a2bf4-e23a-40d1-a8c9-441449f64087 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:14.966615 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-541a2bf4-e23a-40d1-a8c9-441449f64087 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1706 microversion: 2.1 time: 0.235985 Jun 07 13:25:14.967331 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 417/808] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:14 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1706 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:25:15.986479 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-530c6462-7991-4b1d-b500-6ad533b1f355 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:15.987244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-530c6462-7991-4b1d-b500-6ad533b1f355 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:15.996350 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-530c6462-7991-4b1d-b500-6ad533b1f355 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:15.996817 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-530c6462-7991-4b1d-b500-6ad533b1f355 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:15.997714 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-530c6462-7991-4b1d-b500-6ad533b1f355 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:15.998046 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-530c6462-7991-4b1d-b500-6ad533b1f355 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:16.238086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-530c6462-7991-4b1d-b500-6ad533b1f355 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:16.247493 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-530c6462-7991-4b1d-b500-6ad533b1f355 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1706 microversion: 2.1 time: 0.267507 Jun 07 13:25:16.248271 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 392/809] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:15 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1706 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:17.266219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9719782d-b629-42db-b941-3f8024f2cf1d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:17.267479 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9719782d-b629-42db-b941-3f8024f2cf1d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:17.279295 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9719782d-b629-42db-b941-3f8024f2cf1d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:17.280091 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9719782d-b629-42db-b941-3f8024f2cf1d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:17.280925 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9719782d-b629-42db-b941-3f8024f2cf1d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:17.281541 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9719782d-b629-42db-b941-3f8024f2cf1d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:17.446183 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9719782d-b629-42db-b941-3f8024f2cf1d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:17.460681 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9719782d-b629-42db-b941-3f8024f2cf1d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1710 microversion: 2.1 time: 0.198477 Jun 07 13:25:17.461445 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 418/810] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:17 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1710 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:30.672758 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-30c65259-a090-499f-922a-c6af3178c105 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:30.673686 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-30c65259-a090-499f-922a-c6af3178c105 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:30.676417 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:30.677064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:30.684289 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-30c65259-a090-499f-922a-c6af3178c105 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:30.684573 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-30c65259-a090-499f-922a-c6af3178c105 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:30.685351 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-30c65259-a090-499f-922a-c6af3178c105 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:30.685789 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-30c65259-a090-499f-922a-c6af3178c105 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:30.716109 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-30c65259-a090-499f-922a-c6af3178c105 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047290 Jun 07 13:25:30.716946 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 393/811] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Jun 7 13:25:30 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:30.774478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-daca31c6-5218-47e5-a8ce-3ad6802b9e79 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:30.775017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-daca31c6-5218-47e5-a8ce-3ad6802b9e79 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:30.777166 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:30.777907 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=31 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:30.784035 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-daca31c6-5218-47e5-a8ce-3ad6802b9e79 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:30.784501 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-daca31c6-5218-47e5-a8ce-3ad6802b9e79 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:30.785277 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-daca31c6-5218-47e5-a8ce-3ad6802b9e79 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:30.785724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-daca31c6-5218-47e5-a8ce-3ad6802b9e79 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:30.811369 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-daca31c6-5218-47e5-a8ce-3ad6802b9e79 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:25:30.886955 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-daca31c6-5218-47e5-a8ce-3ad6802b9e79 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 204 len: 0 microversion: 2.20 time: 0.116006 Jun 07 13:25:30.887800 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 419/812] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Jun 7 13:25:30 2022] DELETE /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:25:30.896432 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:30.897065 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:30.903173 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:30.903661 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:30.904427 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:30.904868 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:31.035225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:31.044063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:31.045621 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:31.046797 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1d329883-831f-47e0-99c3-0840b28808ee tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.154999 Jun 07 13:25:31.047415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 394/813] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:30 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:25:32.066934 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:32.067628 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:32.073589 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:32.074611 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:32.075394 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:32.075824 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:32.207739 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:32.215702 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:32.217254 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:32.218374 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a0b34683-149c-4b35-8e29-3cf7269360d6 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1723 microversion: 2.20 time: 0.155717 Jun 07 13:25:32.219016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 420/814] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:32 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:25:33.237019 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:33.237635 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:33.244898 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:33.245397 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:33.246180 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:33.246619 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:33.314600 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:33.324504 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:33.326664 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '326e0d70244f46059664a135aefab0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346889f9c6334aa9a22bd277aa002a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:33.328086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-dd047012-349d-41ce-bffb-49277c4e5f6a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 200 len: 1656 microversion: 2.20 time: 0.095325 Jun 07 13:25:33.329589 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 395/815] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:33 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 1656 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:25:33.602302 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-071bbb13-ba45-40ad-95d1-c7696e3614e7 req-8efd1e9d-a97e-4afb-9415-3132d772a9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c812d20c-e7fd-49b1-9813-91433ee35219", "name": "network-vif-deleted", "tag": "1df72142-8d3b-4965-899a-3271031c03d3"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:33.617756 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-071bbb13-ba45-40ad-95d1-c7696e3614e7 req-8efd1e9d-a97e-4afb-9415-3132d772a9dd service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:33.618342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-071bbb13-ba45-40ad-95d1-c7696e3614e7 req-8efd1e9d-a97e-4afb-9415-3132d772a9dd service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:33.638725 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-071bbb13-ba45-40ad-95d1-c7696e3614e7 req-8efd1e9d-a97e-4afb-9415-3132d772a9dd service nova] Creating event network-vif-deleted:1df72142-8d3b-4965-899a-3271031c03d3 for instance c812d20c-e7fd-49b1-9813-91433ee35219 on hv-cinder-84460 Jun 07 13:25:33.645361 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-071bbb13-ba45-40ad-95d1-c7696e3614e7 req-8efd1e9d-a97e-4afb-9415-3132d772a9dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046477 Jun 07 13:25:33.646027 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 421/816] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:34.347872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:34.348701 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:34.357105 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:34.357463 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:34.359350 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:34.360323 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:34.382139 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] HTTP exception thrown: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Request method failure captured: Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 HTTP/1.1 Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1BV_EOo5J6WhvRhMPFjDG8m-YtfeA6ektvI1TYliskn96EvbrJudbmoUiU519DzSrJuLqbwYUW55XC7rJcRbtFfV6QlYc8UH2Ja4x4xyytpCDwU3dLzLYhRsRkQv2Qvw0lusDXqOj-uohX-vR_OhHNUgjXBOp2n3q6d0dsxeOFBG3s Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:25:34.383999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 326e0d70244f46059664a135aefab0f0 Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:34.386411 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': 'c812d20c-e7fd-49b1-9813-91433ee35219'} Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:34.388171 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:34.389851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.391230 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Returning 404 to user: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:34.391230 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e0cf1060-8013-42d0-8c2b-64d33f82113f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 404 len: 111 microversion: 2.20 time: 0.043863 Jun 07 13:25:34.391230 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 396/817] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:34 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:25:34.397482 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-93bf176b-d169-4b8f-a2ca-20ce3ee4f97a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '.version_select at 0x7f46a3663e50>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:34.416226 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-93bf176b-d169-4b8f-a2ca-20ce3ee4f97a tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380928719" status: 204 len: 0 microversion: 2.20 time: 0.023425 Jun 07 13:25:34.416954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 422/818] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Jun 7 13:25:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380928719 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:25:36.226262 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:36.226860 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:36.233318 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:36.233831 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:36.234606 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:36.235323 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:36.248789 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] HTTP exception thrown: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Request method failure captured: Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 HTTP/1.1 Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1BV_EOo5J6WhvRhMPFjDG8m-YtfeA6ektvI1TYliskn96EvbrJudbmoUiU519DzSrJuLqbwYUW55XC7rJcRbtFfV6QlYc8UH2Ja4x4xyytpCDwU3dLzLYhRsRkQv2Qvw0lusDXqOj-uohX-vR_OhHNUgjXBOp2n3q6d0dsxeOFBG3s Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:25:36.250428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 326e0d70244f46059664a135aefab0f0 Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.252064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': 'c812d20c-e7fd-49b1-9813-91433ee35219'} Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:36.252965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.254395 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.255791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Returning 404 to user: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:36.255791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cb6748f0-dd86-46bb-a6d2-b7d99be45b2f tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 404 len: 111 microversion: 2.20 time: 0.029613 Jun 07 13:25:36.255791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 397/819] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Jun 7 13:25:36 2022] DELETE /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 13:25:36.260389 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:36.261116 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: c812d20c-e7fd-49b1-9813-91433ee35219] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:36.268140 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:36.268959 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:36.270290 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:36.271126 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:36.291117 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] HTTP exception thrown: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Request method failure captured: Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 HTTP/1.1 Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1BV_EOo5J6WhvRhMPFjDG8m-YtfeA6ektvI1TYliskn96EvbrJudbmoUiU519DzSrJuLqbwYUW55XC7rJcRbtFfV6QlYc8UH2Ja4x4xyytpCDwU3dLzLYhRsRkQv2Qvw0lusDXqOj-uohX-vR_OhHNUgjXBOp2n3q6d0dsxeOFBG3s Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:25:36.293179 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 326e0d70244f46059664a135aefab0f0 Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.294785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': 'c812d20c-e7fd-49b1-9813-91433ee35219'} Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:36.295792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. Jun 07 13:25:36.297409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:36.298924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Returning 404 to user: Instance c812d20c-e7fd-49b1-9813-91433ee35219 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:36.298924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-02e90545-0e3a-4c36-98aa-61dd4acf45e8 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219" status: 404 len: 111 microversion: 2.20 time: 0.038294 Jun 07 13:25:36.298924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 423/820] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:36 2022] GET /compute/v2.1/servers/c812d20c-e7fd-49b1-9813-91433ee35219 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 13:25:37.442703 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:37.443325 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:37.450016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:37.450469 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:37.451259 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:37.451697 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:37.465610 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] HTTP exception thrown: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Request method failure captured: Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 HTTP/1.1 Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1BV_EOo5J6WhvRhMPFjDG8m-YtfeA6ektvI1TYliskn96EvbrJudbmoUiU519DzSrJuLqbwYUW55XC7rJcRbtFfV6QlYc8UH2Ja4x4xyytpCDwU3dLzLYhRsRkQv2Qvw0lusDXqOj-uohX-vR_OhHNUgjXBOp2n3q6d0dsxeOFBG3s Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:25:37.467207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 326e0d70244f46059664a135aefab0f0 Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.468809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '9a2d4bcb-ea81-4550-be2e-2689fffd0943'} Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:37.469612 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.470784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.472467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Returning 404 to user: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:37.472467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-29bfdca6-51a8-4805-a3f8-f4cb08eea1e7 tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 404 len: 111 microversion: 2.20 time: 0.030841 Jun 07 13:25:37.472467 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 398/821] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Jun 7 13:25:37 2022] DELETE /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 13:25:37.477580 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:37.478196 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] [instance: 9a2d4bcb-ea81-4550-be2e-2689fffd0943] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:37.484602 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:37.485315 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:37.486064 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:37.486497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:37.500334 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] HTTP exception thrown: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Request method failure captured: Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 HTTP/1.1 Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1BV_EOo5J6WhvRhMPFjDG8m-YtfeA6ektvI1TYliskn96EvbrJudbmoUiU519DzSrJuLqbwYUW55XC7rJcRbtFfV6QlYc8UH2Ja4x4xyytpCDwU3dLzLYhRsRkQv2Qvw0lusDXqOj-uohX-vR_OhHNUgjXBOp2n3q6d0dsxeOFBG3s Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:25:37.501834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_346889f9c6334aa9a22bd277aa002a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 346889f9c6334aa9a22bd277aa002a0f Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1438765139 Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 326e0d70244f46059664a135aefab0f0 Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1438765139-project Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.503535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '9a2d4bcb-ea81-4550-be2e-2689fffd0943'} Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:37.504478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. Jun 07 13:25:37.505942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:25:37.507383 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] Returning 404 to user: Instance 9a2d4bcb-ea81-4550-be2e-2689fffd0943 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:37.507383 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7601e392-149b-46f5-9856-1ef5bb2da4ab tempest-AttachVolumeShelveTestJSON-1438765139 tempest-AttachVolumeShelveTestJSON-1438765139-project] 10.222.0.61 "GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943" status: 404 len: 111 microversion: 2.20 time: 0.029490 Jun 07 13:25:37.507383 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 424/822] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Jun 7 13:25:37 2022] GET /compute/v2.1/servers/9a2d4bcb-ea81-4550-be2e-2689fffd0943 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:25:42.897934 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-aaff4176-4e4c-4b52-8c45-c71433d7d19b tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46ac85c820>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:42.950784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-aaff4176-4e4c-4b52-8c45-c71433d7d19b tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/ad3371ba-00b1-4d49-8653-d5605f94491a" status: 200 len: 351 microversion: 2.1 time: 0.056716 Jun 07 13:25:42.951394 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 399/823] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:25:42 2022] GET /compute/v2.1/os-volumes/ad3371ba-00b1-4d49-8653-d5605f94491a => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:49.506569 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fd34283f-b8c6-4a07-8e17-bfcaaf931fa7 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46a3663550>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:49.514342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:49.515344 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:49.559378 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fd34283f-b8c6-4a07-8e17-bfcaaf931fa7 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2a3ce755-bb58-4bfc-bb71-c6a8be345655" status: 200 len: 351 microversion: 2.1 time: 0.056478 Jun 07 13:25:49.559938 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 425/824] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:25:49 2022] GET /compute/v2.1/os-volumes/2a3ce755-bb58-4bfc-bb71-c6a8be345655 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:55.076176 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=12 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:55.077146 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=24 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:55.081515 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b70247dd-df9e-4773-879d-5d7a553a92c3 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46ac8cfe50>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:55.135044 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b70247dd-df9e-4773-879d-5d7a553a92c3 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/5199a633-50a0-4059-9209-379766c85a1f" status: 200 len: 351 microversion: 2.1 time: 0.060455 Jun 07 13:25:55.135783 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 400/825] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Jun 7 13:25:55 2022] GET /compute/v2.1/os-volumes/5199a633-50a0-4059-9209-379766c85a1f => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:55.147425 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-336d462b-056a-4d77-b7f7-7af96c8f8752 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46a8064a60>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:55.229196 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-336d462b-056a-4d77-b7f7-7af96c8f8752 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085453 Jun 07 13:25:55.229764 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 426/826] 10.222.0.61 () {58 vars in 1133 bytes} [Tue Jun 7 13:25:55 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:55.242064 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-56ed2d78-f301-40d2-88db-ee934bea5315 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46a35b8c10>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:55.324489 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-56ed2d78-f301-40d2-88db-ee934bea5315 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086100 Jun 07 13:25:55.325645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 401/827] 10.222.0.61 () {58 vars in 1148 bytes} [Tue Jun 7 13:25:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:55.337186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-dfee04f5-7e33-47ea-9fa6-e824278c0312 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46a35d4700>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:55.419092 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-dfee04f5-7e33-47ea-9fa6-e824278c0312 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085131 Jun 07 13:25:55.419660 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 427/828] 10.222.0.61 () {58 vars in 1133 bytes} [Tue Jun 7 13:25:55 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:55.430679 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fddc1225-f3d0-4a84-9d87-199848434e67 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46a369bdc0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:55.510879 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fddc1225-f3d0-4a84-9d87-199848434e67 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083879 Jun 07 13:25:55.511459 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 402/829] 10.222.0.61 () {58 vars in 1166 bytes} [Tue Jun 7 13:25:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:55.522720 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-951b4101-32bc-4c52-838b-59ec1a80e369 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46a35c8dc0>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:55.602232 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-951b4101-32bc-4c52-838b-59ec1a80e369 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083165 Jun 07 13:25:55.602807 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 428/830] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Jun 7 13:25:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:55.615318 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-480ed095-b7f8-4d08-83c9-be16640f79df tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46ac8cf310>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:55.695766 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-480ed095-b7f8-4d08-83c9-be16640f79df tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084117 Jun 07 13:25:55.696568 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 403/831] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Jun 7 13:25:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:55.707513 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d26318f2-0cf8-4e43-ae4c-d2bd1959dc97 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46a372b4c0>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:55.788366 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d26318f2-0cf8-4e43-ae4c-d2bd1959dc97 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084494 Jun 07 13:25:55.788980 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 429/832] 10.222.0.61 () {58 vars in 1187 bytes} [Tue Jun 7 13:25:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:25:55.800884 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-36b0b637-6d2b-4383-9d32-11246d1d6216 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] Calling method '.version_select at 0x7f46a36858b0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:55.880143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-36b0b637-6d2b-4383-9d32-11246d1d6216 tempest-VolumesTestJSON-1381935251 tempest-VolumesTestJSON-1381935251-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082943 Jun 07 13:25:55.880712 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 404/833] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Jun 7 13:25:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:56.034333 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2137063093", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1670039504", "security_groups": [{"name": "tempest-secgroup-smoke-2066727904"}], "block_device_mapping_v2": [{"uuid": "8e901210-3000-4e1d-9b4f-69a89ba41814", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f22df14-4055-4a5c-b07f-b9c47fcaaaf4"}]}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:56.152551 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] validate_networks() for [('9f22df14-4055-4a5c-b07f-b9c47fcaaaf4', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:25:56.526273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:25:56.526698 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:25:56.527340 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:25:56.527749 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:25:56.528766 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:25:56.537576 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:56.538024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:56.538820 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:56.539280 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:56.556810 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Getting quotas for project b562a09561af4197bf2835b31a9dd34e. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:25:56.561191 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Getting quotas for user 36c5458a18f146be87207e0f6dd598eb and project b562a09561af4197bf2835b31a9dd34e. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:25:56.616079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:25:56.618127 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e901210-3000-4e1d-9b4f-69a89ba41814',volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:25:56.740840 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-505fb73d-1b7e-442c-8d5a-17c74ffadd8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710405 Jun 07 13:25:56.741474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 430/834] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:25:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:25:56.752009 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-14c4967f-bd2e-463a-9df1-795a9d3e7f79 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:56.752622 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-14c4967f-bd2e-463a-9df1-795a9d3e7f79 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:56.805845 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-14c4967f-bd2e-463a-9df1-795a9d3e7f79 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:56.812942 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-14c4967f-bd2e-463a-9df1-795a9d3e7f79 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1095 microversion: 2.1 time: 0.065247 Jun 07 13:25:56.813708 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 405/835] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:56 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:57.829639 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c5a21109-2de6-4d2a-9e7c-405eed72376f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:57.830260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c5a21109-2de6-4d2a-9e7c-405eed72376f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:57.836836 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5a21109-2de6-4d2a-9e7c-405eed72376f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:57.837293 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5a21109-2de6-4d2a-9e7c-405eed72376f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:57.838052 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5a21109-2de6-4d2a-9e7c-405eed72376f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:57.838489 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c5a21109-2de6-4d2a-9e7c-405eed72376f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:57.899777 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c5a21109-2de6-4d2a-9e7c-405eed72376f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:57.908760 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c5a21109-2de6-4d2a-9e7c-405eed72376f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1211 microversion: 2.1 time: 0.083079 Jun 07 13:25:57.909349 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 431/836] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:57 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:58.926508 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-303c2cb1-0538-4fc9-8836-7268d83d77fd tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:58.927195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-303c2cb1-0538-4fc9-8836-7268d83d77fd tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:58.934131 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-303c2cb1-0538-4fc9-8836-7268d83d77fd tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:58.934589 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-303c2cb1-0538-4fc9-8836-7268d83d77fd tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:58.935397 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-303c2cb1-0538-4fc9-8836-7268d83d77fd tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:58.935844 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-303c2cb1-0538-4fc9-8836-7268d83d77fd tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:59.108090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-303c2cb1-0538-4fc9-8836-7268d83d77fd tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:59.115992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-303c2cb1-0538-4fc9-8836-7268d83d77fd tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.193870 Jun 07 13:25:59.116654 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 406/837] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:58 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:59.574297 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-b43a7d7c-78cc-4eab-9dee-0ba5a3d8ec8b req-b9cfd101-b6bc-46e1-acb4-341ae1ccba2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50eb4fa0-5e14-46c7-89db-b095754d73ea", "tag": "b83954e8-7ec5-4676-8eb6-33daf88474b1"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:59.594894 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-b43a7d7c-78cc-4eab-9dee-0ba5a3d8ec8b req-b9cfd101-b6bc-46e1-acb4-341ae1ccba2b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:59.595330 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-b43a7d7c-78cc-4eab-9dee-0ba5a3d8ec8b req-b9cfd101-b6bc-46e1-acb4-341ae1ccba2b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:59.631458 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-b43a7d7c-78cc-4eab-9dee-0ba5a3d8ec8b req-b9cfd101-b6bc-46e1-acb4-341ae1ccba2b service nova] Creating event network-changed:b83954e8-7ec5-4676-8eb6-33daf88474b1 for instance 50eb4fa0-5e14-46c7-89db-b095754d73ea on hv-cinder-84460 Jun 07 13:25:59.641942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-b43a7d7c-78cc-4eab-9dee-0ba5a3d8ec8b req-b9cfd101-b6bc-46e1-acb4-341ae1ccba2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072143 Jun 07 13:25:59.642585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 432/838] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:00.133576 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c4db1e54-fb77-4337-96d8-7129c2d936bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:00.134239 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c4db1e54-fb77-4337-96d8-7129c2d936bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:00.140600 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4db1e54-fb77-4337-96d8-7129c2d936bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:00.141054 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4db1e54-fb77-4337-96d8-7129c2d936bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:00.142016 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4db1e54-fb77-4337-96d8-7129c2d936bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:00.142456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c4db1e54-fb77-4337-96d8-7129c2d936bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:00.304195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c4db1e54-fb77-4337-96d8-7129c2d936bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:00.313058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c4db1e54-fb77-4337-96d8-7129c2d936bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.183527 Jun 07 13:26:00.313932 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 407/839] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:00 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:01.333322 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f30c234a-072d-4f2f-be53-d73c07dc5354 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:01.334050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f30c234a-072d-4f2f-be53-d73c07dc5354 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:01.347250 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f30c234a-072d-4f2f-be53-d73c07dc5354 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:01.349552 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f30c234a-072d-4f2f-be53-d73c07dc5354 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:01.351006 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f30c234a-072d-4f2f-be53-d73c07dc5354 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:01.351811 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f30c234a-072d-4f2f-be53-d73c07dc5354 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:01.648848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f30c234a-072d-4f2f-be53-d73c07dc5354 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:01.659137 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f30c234a-072d-4f2f-be53-d73c07dc5354 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.332556 Jun 07 13:26:01.659719 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 433/840] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:01 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:02.677341 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9e2cfef7-e098-4b1c-97a3-8c872993e990 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:02.679600 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9e2cfef7-e098-4b1c-97a3-8c872993e990 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:02.693339 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9e2cfef7-e098-4b1c-97a3-8c872993e990 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:02.694085 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9e2cfef7-e098-4b1c-97a3-8c872993e990 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:02.695123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9e2cfef7-e098-4b1c-97a3-8c872993e990 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:02.695877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9e2cfef7-e098-4b1c-97a3-8c872993e990 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:03.181734 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9e2cfef7-e098-4b1c-97a3-8c872993e990 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:03.195068 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9e2cfef7-e098-4b1c-97a3-8c872993e990 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.522673 Jun 07 13:26:03.196265 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 408/841] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:02 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:04.214655 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-27cf2110-e88c-49c8-b79d-41ee185a5006 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:04.215250 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-27cf2110-e88c-49c8-b79d-41ee185a5006 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:04.224679 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-27cf2110-e88c-49c8-b79d-41ee185a5006 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:04.225133 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-27cf2110-e88c-49c8-b79d-41ee185a5006 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:04.225914 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-27cf2110-e88c-49c8-b79d-41ee185a5006 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:04.226354 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-27cf2110-e88c-49c8-b79d-41ee185a5006 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:04.493523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-27cf2110-e88c-49c8-b79d-41ee185a5006 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:04.520612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-27cf2110-e88c-49c8-b79d-41ee185a5006 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.309155 Jun 07 13:26:04.521226 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 434/842] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:04 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:05.538674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-aa8d7d4e-ed92-4c26-8b59-e9ccb57d78f6 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:05.540338 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-aa8d7d4e-ed92-4c26-8b59-e9ccb57d78f6 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:05.547894 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aa8d7d4e-ed92-4c26-8b59-e9ccb57d78f6 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.548348 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aa8d7d4e-ed92-4c26-8b59-e9ccb57d78f6 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.549119 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aa8d7d4e-ed92-4c26-8b59-e9ccb57d78f6 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.549554 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-aa8d7d4e-ed92-4c26-8b59-e9ccb57d78f6 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.700857 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-aa8d7d4e-ed92-4c26-8b59-e9ccb57d78f6 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:05.708996 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-aa8d7d4e-ed92-4c26-8b59-e9ccb57d78f6 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.175402 Jun 07 13:26:05.710486 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 409/843] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:05 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:06.729169 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c36544bb-e22f-4e9c-a5b3-aa817b9eba76 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:06.730031 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c36544bb-e22f-4e9c-a5b3-aa817b9eba76 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:06.735574 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:06.736728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=6 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:06.741740 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c36544bb-e22f-4e9c-a5b3-aa817b9eba76 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:06.742391 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c36544bb-e22f-4e9c-a5b3-aa817b9eba76 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:06.743560 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c36544bb-e22f-4e9c-a5b3-aa817b9eba76 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:06.744104 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c36544bb-e22f-4e9c-a5b3-aa817b9eba76 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:06.908759 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c36544bb-e22f-4e9c-a5b3-aa817b9eba76 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:06.919923 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c36544bb-e22f-4e9c-a5b3-aa817b9eba76 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.196474 Jun 07 13:26:06.931308 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 435/844] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:06 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:07.937951 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-b831571f-82c5-48b1-bb8d-c57f51ea4e6f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:07.938925 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-b831571f-82c5-48b1-bb8d-c57f51ea4e6f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:07.944871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:07.946959 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b831571f-82c5-48b1-bb8d-c57f51ea4e6f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:07.949158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b831571f-82c5-48b1-bb8d-c57f51ea4e6f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:07.949158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b831571f-82c5-48b1-bb8d-c57f51ea4e6f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:07.950998 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-b831571f-82c5-48b1-bb8d-c57f51ea4e6f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:08.368024 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-b831571f-82c5-48b1-bb8d-c57f51ea4e6f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:08.382208 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-b831571f-82c5-48b1-bb8d-c57f51ea4e6f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.443573 Jun 07 13:26:08.383236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 410/845] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:07 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:09.401194 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-49ea0a96-8a0d-4cc5-8f54-defd59fb9bbf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:09.401794 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-49ea0a96-8a0d-4cc5-8f54-defd59fb9bbf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:09.419566 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-49ea0a96-8a0d-4cc5-8f54-defd59fb9bbf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:09.420268 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-49ea0a96-8a0d-4cc5-8f54-defd59fb9bbf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:09.421213 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-49ea0a96-8a0d-4cc5-8f54-defd59fb9bbf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:09.421831 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-49ea0a96-8a0d-4cc5-8f54-defd59fb9bbf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:10.191136 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-49ea0a96-8a0d-4cc5-8f54-defd59fb9bbf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:10.199505 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-49ea0a96-8a0d-4cc5-8f54-defd59fb9bbf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.802277 Jun 07 13:26:10.203825 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 436/846] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:09 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:11.220332 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ed9963c4-32ce-4369-8d9e-27d8b2b8b009 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:11.221065 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ed9963c4-32ce-4369-8d9e-27d8b2b8b009 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:11.262196 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ed9963c4-32ce-4369-8d9e-27d8b2b8b009 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:11.269691 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ed9963c4-32ce-4369-8d9e-27d8b2b8b009 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:11.270650 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ed9963c4-32ce-4369-8d9e-27d8b2b8b009 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:11.272090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ed9963c4-32ce-4369-8d9e-27d8b2b8b009 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:11.686766 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ed9963c4-32ce-4369-8d9e-27d8b2b8b009 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:11.698460 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ed9963c4-32ce-4369-8d9e-27d8b2b8b009 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.482305 Jun 07 13:26:11.710374 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 411/847] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:11 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:12.318066 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-112f7d67-7063-4a64-b43f-17e4add6583f req-a3610036-661b-49a6-97ba-2dbce9b7ed6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50eb4fa0-5e14-46c7-89db-b095754d73ea", "name": "network-vif-plugged", "status": "completed", "tag": "b83954e8-7ec5-4676-8eb6-33daf88474b1"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:12.334624 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-112f7d67-7063-4a64-b43f-17e4add6583f req-a3610036-661b-49a6-97ba-2dbce9b7ed6e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:12.335043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-112f7d67-7063-4a64-b43f-17e4add6583f req-a3610036-661b-49a6-97ba-2dbce9b7ed6e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:12.360178 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-112f7d67-7063-4a64-b43f-17e4add6583f req-a3610036-661b-49a6-97ba-2dbce9b7ed6e service nova] Creating event network-vif-plugged:b83954e8-7ec5-4676-8eb6-33daf88474b1 for instance 50eb4fa0-5e14-46c7-89db-b095754d73ea on hv-cinder-84460 Jun 07 13:26:12.382389 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-112f7d67-7063-4a64-b43f-17e4add6583f req-a3610036-661b-49a6-97ba-2dbce9b7ed6e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068307 Jun 07 13:26:12.386276 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 437/848] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:12.717679 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-61bfe3b7-5dca-4f33-ab68-3664638bf219 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:12.718812 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-61bfe3b7-5dca-4f33-ab68-3664638bf219 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:12.734754 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-61bfe3b7-5dca-4f33-ab68-3664638bf219 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:12.738657 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-61bfe3b7-5dca-4f33-ab68-3664638bf219 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:12.742320 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-61bfe3b7-5dca-4f33-ab68-3664638bf219 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:12.742985 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-61bfe3b7-5dca-4f33-ab68-3664638bf219 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:12.997492 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-61bfe3b7-5dca-4f33-ab68-3664638bf219 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:13.006807 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-61bfe3b7-5dca-4f33-ab68-3664638bf219 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.293360 Jun 07 13:26:13.008689 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 412/849] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:12 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:14.031144 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2d68e2b5-ac61-4b2f-80af-bc180e1148bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:14.032664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2d68e2b5-ac61-4b2f-80af-bc180e1148bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:14.043653 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d68e2b5-ac61-4b2f-80af-bc180e1148bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:14.049926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d68e2b5-ac61-4b2f-80af-bc180e1148bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:14.051005 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d68e2b5-ac61-4b2f-80af-bc180e1148bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:14.051610 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2d68e2b5-ac61-4b2f-80af-bc180e1148bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:14.301531 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2d68e2b5-ac61-4b2f-80af-bc180e1148bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:14.316348 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2d68e2b5-ac61-4b2f-80af-bc180e1148bb tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1267 microversion: 2.1 time: 0.294488 Jun 07 13:26:14.322054 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 438/850] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:14 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:15.338863 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5f6321ad-cfb7-4b60-a667-115182f340f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:15.339486 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5f6321ad-cfb7-4b60-a667-115182f340f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:15.352650 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5f6321ad-cfb7-4b60-a667-115182f340f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.353526 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5f6321ad-cfb7-4b60-a667-115182f340f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.357253 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5f6321ad-cfb7-4b60-a667-115182f340f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.357964 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5f6321ad-cfb7-4b60-a667-115182f340f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.583787 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5f6321ad-cfb7-4b60-a667-115182f340f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:15.593718 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5f6321ad-cfb7-4b60-a667-115182f340f0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1453 microversion: 2.1 time: 0.258685 Jun 07 13:26:15.602678 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 413/851] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:15 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1453 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:15.622455 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-14b07cf9-23de-49df-9a18-b5567eafbfb0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:15.624619 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-14b07cf9-23de-49df-9a18-b5567eafbfb0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:15.645683 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-14b07cf9-23de-49df-9a18-b5567eafbfb0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.647883 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-14b07cf9-23de-49df-9a18-b5567eafbfb0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.649997 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-14b07cf9-23de-49df-9a18-b5567eafbfb0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.650903 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-14b07cf9-23de-49df-9a18-b5567eafbfb0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.896339 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-14b07cf9-23de-49df-9a18-b5567eafbfb0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:15.906285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-14b07cf9-23de-49df-9a18-b5567eafbfb0 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1453 microversion: 2.1 time: 0.289198 Jun 07 13:26:15.919226 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 439/852] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:15 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1453 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:18.891229 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-c7fc5de6-0e38-4714-b471-0b96a95fccdb req-c209cb2f-9d49-40c2-8c65-9f9b97bc4dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50eb4fa0-5e14-46c7-89db-b095754d73ea", "tag": "b83954e8-7ec5-4676-8eb6-33daf88474b1"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:18.900606 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-c7fc5de6-0e38-4714-b471-0b96a95fccdb req-c209cb2f-9d49-40c2-8c65-9f9b97bc4dd7 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:18.901453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-c7fc5de6-0e38-4714-b471-0b96a95fccdb req-c209cb2f-9d49-40c2-8c65-9f9b97bc4dd7 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:18.913901 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-c7fc5de6-0e38-4714-b471-0b96a95fccdb req-c209cb2f-9d49-40c2-8c65-9f9b97bc4dd7 service nova] Creating event network-changed:b83954e8-7ec5-4676-8eb6-33daf88474b1 for instance 50eb4fa0-5e14-46c7-89db-b095754d73ea on hv-cinder-84460 Jun 07 13:26:18.938229 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-c7fc5de6-0e38-4714-b471-0b96a95fccdb req-c209cb2f-9d49-40c2-8c65-9f9b97bc4dd7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050899 Jun 07 13:26:18.942981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 414/853] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:20.310387 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-91086116", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "networks": [{"uuid": "749bef9f-ed8d-4079-86c1-f28336ec4a01"}]}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:20.323801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:20.376603 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] validate_networks() for [('749bef9f-ed8d-4079-86c1-f28336ec4a01', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:26:20.670421 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2061d932-f61d-4a22-b3c1-1eacaa4c8f3f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:20.671038 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2061d932-f61d-4a22-b3c1-1eacaa4c8f3f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:20.678178 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2061d932-f61d-4a22-b3c1-1eacaa4c8f3f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:20.678896 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2061d932-f61d-4a22-b3c1-1eacaa4c8f3f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:20.682004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2061d932-f61d-4a22-b3c1-1eacaa4c8f3f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:20.682656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2061d932-f61d-4a22-b3c1-1eacaa4c8f3f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:20.786995 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-2061d932-f61d-4a22-b3c1-1eacaa4c8f3f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lazy-loading 'services' on Instance uuid 1a5264ef-a5c4-498e-8c65-af627dcfa757 {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:26:20.806926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:26:20.806926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:26:20.806926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:26:20.806926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:26:20.806926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:26:20.816978 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:20.817425 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:20.818231 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:20.818669 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:20.828314 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=49 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:20.845400 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Getting quotas for project a004938108be44fd8367b8fae5592613. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:26:20.864842 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Getting quotas for user 625ae02165844f9baa4d6672eafbb6d6 and project a004938108be44fd8367b8fae5592613. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:26:20.877327 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:26:20.879653 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:26:20.978922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2061d932-f61d-4a22-b3c1-1eacaa4c8f3f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/os-volume_attachments/dd122157-138e-4b91-9ba4-a6d40b95a8c1" status: 202 len: 0 microversion: 2.1 time: 0.312887 Jun 07 13:26:20.982770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2f77ca1b-4780-4a2c-bde5-c3aaf33b834f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677700 Jun 07 13:26:20.983320 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 415/854] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:26:20 2022] DELETE /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/os-volume_attachments/dd122157-138e-4b91-9ba4-a6d40b95a8c1 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:26:20.986873 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 440/855] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:26:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:26:20.994736 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0c82cd73-9e66-4977-85a3-51cf2c7cf2e1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:20.995609 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0c82cd73-9e66-4977-85a3-51cf2c7cf2e1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:21.079426 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0c82cd73-9e66-4977-85a3-51cf2c7cf2e1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:21.086473 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0c82cd73-9e66-4977-85a3-51cf2c7cf2e1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1217 microversion: 2.1 time: 0.095873 Jun 07 13:26:21.087072 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 416/856] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:20 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:22.103634 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-33a9d28a-c6fd-4cb1-b295-b9164056fc5b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:22.104251 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-33a9d28a-c6fd-4cb1-b295-b9164056fc5b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:22.118264 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-33a9d28a-c6fd-4cb1-b295-b9164056fc5b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.118716 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-33a9d28a-c6fd-4cb1-b295-b9164056fc5b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.119519 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-33a9d28a-c6fd-4cb1-b295-b9164056fc5b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.120077 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-33a9d28a-c6fd-4cb1-b295-b9164056fc5b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.152545 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-92a6b597-8c18-498e-bb81-c167aa03b07a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:22.167499 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-92a6b597-8c18-498e-bb81-c167aa03b07a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.175597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-92a6b597-8c18-498e-bb81-c167aa03b07a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.211674 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-92a6b597-8c18-498e-bb81-c167aa03b07a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Going to try to stop instance {{(pid=117842) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 13:26:22.271027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-92a6b597-8c18-498e-bb81-c167aa03b07a tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/action" status: 202 len: 0 microversion: 2.1 time: 0.120945 Jun 07 13:26:22.271426 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-33a9d28a-c6fd-4cb1-b295-b9164056fc5b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:22.272566 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 417/857] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:26:22 2022] POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:26:22.284433 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-33a9d28a-c6fd-4cb1-b295-b9164056fc5b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1269 microversion: 2.1 time: 0.184461 Jun 07 13:26:22.285138 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c2ddc45f-70aa-4054-aba9-020659db4801 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:22.285428 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 441/858] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:22 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1269 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:22.286556 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c2ddc45f-70aa-4054-aba9-020659db4801 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:22.295810 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c2ddc45f-70aa-4054-aba9-020659db4801 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.296608 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c2ddc45f-70aa-4054-aba9-020659db4801 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.297611 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c2ddc45f-70aa-4054-aba9-020659db4801 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.298271 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c2ddc45f-70aa-4054-aba9-020659db4801 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.515734 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c2ddc45f-70aa-4054-aba9-020659db4801 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:22.527156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c2ddc45f-70aa-4054-aba9-020659db4801 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.249309 Jun 07 13:26:22.529581 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 418/859] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:22 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:23.301471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3648dc4a-e56e-433c-bbbe-6202ed1a9c61 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:23.302257 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3648dc4a-e56e-433c-bbbe-6202ed1a9c61 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:23.308597 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3648dc4a-e56e-433c-bbbe-6202ed1a9c61 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.310291 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3648dc4a-e56e-433c-bbbe-6202ed1a9c61 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.311740 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3648dc4a-e56e-433c-bbbe-6202ed1a9c61 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.312578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3648dc4a-e56e-433c-bbbe-6202ed1a9c61 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.489635 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3648dc4a-e56e-433c-bbbe-6202ed1a9c61 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:23.498497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3648dc4a-e56e-433c-bbbe-6202ed1a9c61 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.200759 Jun 07 13:26:23.499735 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 442/860] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:23 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:23.546630 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e0ab9849-12c0-4dc1-81c3-cca719f366b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:23.548231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e0ab9849-12c0-4dc1-81c3-cca719f366b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:23.555453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e0ab9849-12c0-4dc1-81c3-cca719f366b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.556183 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e0ab9849-12c0-4dc1-81c3-cca719f366b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.557477 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e0ab9849-12c0-4dc1-81c3-cca719f366b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.558188 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e0ab9849-12c0-4dc1-81c3-cca719f366b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.740310 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e0ab9849-12c0-4dc1-81c3-cca719f366b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:23.749236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e0ab9849-12c0-4dc1-81c3-cca719f366b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.206799 Jun 07 13:26:23.750047 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 419/861] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:23 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:23.909724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-42a6bdfb-f995-44a3-abcc-e957aec2eb26 req-b226c13d-8070-4df3-bd08-fbc6be94171f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6713415a-0881-4a58-990a-a2f14225eb3a", "tag": "c9751bb1-523a-4bf5-99a9-3905114fd3ac"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:23.918279 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-42a6bdfb-f995-44a3-abcc-e957aec2eb26 req-b226c13d-8070-4df3-bd08-fbc6be94171f service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.919859 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-42a6bdfb-f995-44a3-abcc-e957aec2eb26 req-b226c13d-8070-4df3-bd08-fbc6be94171f service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.948020 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-42a6bdfb-f995-44a3-abcc-e957aec2eb26 req-b226c13d-8070-4df3-bd08-fbc6be94171f service nova] Creating event network-changed:c9751bb1-523a-4bf5-99a9-3905114fd3ac for instance 6713415a-0881-4a58-990a-a2f14225eb3a on hv-cinder-84460 Jun 07 13:26:23.952857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-42a6bdfb-f995-44a3-abcc-e957aec2eb26 req-b226c13d-8070-4df3-bd08-fbc6be94171f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048584 Jun 07 13:26:23.953525 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 443/862] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:24.478399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-aa009624-b638-433e-a23d-c98ca4612216 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Action: 'create', calling method: .version_select at 0x7f46a36ea160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-508098056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEahxqXl/5O6ysfjfjG0BfgWU5h107urSwUnveNjHDldMQ+xsGjdz1dyYRUOB9V3+/mWRAFQYDdxhxZ2JXhrfPJnS7twC0O8KmK/NNA9JMQRqhXe7lPAbjg0mMvj5voLg=="}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:24.492402 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-aa009624-b638-433e-a23d-c98ca4612216 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Getting quotas for project 6f612ecb68c2414f92e3887ffeff0cdd. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:26:24.496182 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-aa009624-b638-433e-a23d-c98ca4612216 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Getting quotas for user 0c13da70175548fbbddc42879c3024d5 and project 6f612ecb68c2414f92e3887ffeff0cdd. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:26:24.517704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-261995e2-9c69-41fb-ac75-eaba6df003f0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.518436 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-261995e2-9c69-41fb-ac75-eaba6df003f0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.520473 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-aa009624-b638-433e-a23d-c98ca4612216 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045897 Jun 07 13:26:24.521072 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 420/863] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:26:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:24.525369 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-261995e2-9c69-41fb-ac75-eaba6df003f0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.525826 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-261995e2-9c69-41fb-ac75-eaba6df003f0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.526599 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-261995e2-9c69-41fb-ac75-eaba6df003f0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.527065 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-261995e2-9c69-41fb-ac75-eaba6df003f0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.618942 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1257478588", "imageRef": "e6478e9b-e52a-4026-866b-2684edcf3ba7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-508098056", "networks": [{"uuid": "62d7580a-ccf0-479e-98f4-9f42b4289605"}]}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:24.655676 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-261995e2-9c69-41fb-ac75-eaba6df003f0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:24.663432 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-261995e2-9c69-41fb-ac75-eaba6df003f0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.151430 Jun 07 13:26:24.663996 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 444/864] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:24.669868 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] validate_networks() for [('62d7580a-ccf0-479e-98f4-9f42b4289605', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:26:24.765762 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ea8f1f3a-f14b-49b4-830e-adf27634c4c7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.766507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ea8f1f3a-f14b-49b4-830e-adf27634c4c7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.772559 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ea8f1f3a-f14b-49b4-830e-adf27634c4c7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.773079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ea8f1f3a-f14b-49b4-830e-adf27634c4c7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.773906 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ea8f1f3a-f14b-49b4-830e-adf27634c4c7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.774409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ea8f1f3a-f14b-49b4-830e-adf27634c4c7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.982682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ea8f1f3a-f14b-49b4-830e-adf27634c4c7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:24.990454 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ea8f1f3a-f14b-49b4-830e-adf27634c4c7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.228557 Jun 07 13:26:24.991046 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 445/865] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:25.088904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:26:25.089394 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:26:25.089869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:26:25.090276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:26:25.091302 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:26:25.094444 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:25.101305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:25.101755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:25.102555 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:25.103027 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:25.110746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:25.123974 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Getting quotas for project 6f612ecb68c2414f92e3887ffeff0cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:26:25.127766 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Getting quotas for user 0c13da70175548fbbddc42879c3024d5 and project 6f612ecb68c2414f92e3887ffeff0cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:26:25.138348 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:26:25.140538 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6478e9b-e52a-4026-866b-2684edcf3ba7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:26:25.183363 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [eed7f1e7-df92-4237-b01c-111cbaec727f] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 13:26:25.680936 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3b664a5b-1fbd-48ea-95b6-6dc2907f4ae5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:25.681736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3b664a5b-1fbd-48ea-95b6-6dc2907f4ae5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:25.688051 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3b664a5b-1fbd-48ea-95b6-6dc2907f4ae5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:25.688515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3b664a5b-1fbd-48ea-95b6-6dc2907f4ae5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:25.689342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3b664a5b-1fbd-48ea-95b6-6dc2907f4ae5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:25.689787 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3b664a5b-1fbd-48ea-95b6-6dc2907f4ae5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:25.819122 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3b664a5b-1fbd-48ea-95b6-6dc2907f4ae5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:25.827337 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3b664a5b-1fbd-48ea-95b6-6dc2907f4ae5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.150287 Jun 07 13:26:25.827918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 446/866] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:25 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:26.008242 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-918513b7-dfd3-4f12-8ab9-f635fff2e18e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:26.008875 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-918513b7-dfd3-4f12-8ab9-f635fff2e18e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:26.015643 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-918513b7-dfd3-4f12-8ab9-f635fff2e18e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.016100 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-918513b7-dfd3-4f12-8ab9-f635fff2e18e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.016879 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-918513b7-dfd3-4f12-8ab9-f635fff2e18e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.017318 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-918513b7-dfd3-4f12-8ab9-f635fff2e18e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.145812 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-918513b7-dfd3-4f12-8ab9-f635fff2e18e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:26.153508 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-918513b7-dfd3-4f12-8ab9-f635fff2e18e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.149204 Jun 07 13:26:26.154104 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 447/867] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:26 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:26.191732 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO oslo.messaging._drivers.impl_rabbit [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [eed7f1e7-df92-4237-b01c-111cbaec727f] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 52860. Jun 07 13:26:26.196514 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-79b68746-1358-454b-a970-e647ee43a497 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.581983 Jun 07 13:26:26.197341 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 421/868] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:26:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:26:26.207294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cc8d7924-c2e3-4e11-8127-2d0092b91216 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:26.207916 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-cc8d7924-c2e3-4e11-8127-2d0092b91216 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:26.265693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-cc8d7924-c2e3-4e11-8127-2d0092b91216 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:26.272554 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-cc8d7924-c2e3-4e11-8127-2d0092b91216 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1258 microversion: 2.1 time: 0.069393 Jun 07 13:26:26.273128 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 448/869] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:26 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:26.845481 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c20ecfbf-3060-42f7-a68e-a4777229d1d6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:26.846081 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c20ecfbf-3060-42f7-a68e-a4777229d1d6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:26.852780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c20ecfbf-3060-42f7-a68e-a4777229d1d6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.853236 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c20ecfbf-3060-42f7-a68e-a4777229d1d6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.854000 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c20ecfbf-3060-42f7-a68e-a4777229d1d6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.854438 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c20ecfbf-3060-42f7-a68e-a4777229d1d6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.981498 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c20ecfbf-3060-42f7-a68e-a4777229d1d6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:26.989085 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c20ecfbf-3060-42f7-a68e-a4777229d1d6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.148622 Jun 07 13:26:26.989657 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 422/870] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:26 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:27.169507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2517d7bf-b761-47ae-8c67-a95764cb29db tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:27.170136 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2517d7bf-b761-47ae-8c67-a95764cb29db tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:27.176108 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2517d7bf-b761-47ae-8c67-a95764cb29db tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.176560 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2517d7bf-b761-47ae-8c67-a95764cb29db tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.177330 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2517d7bf-b761-47ae-8c67-a95764cb29db tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.177770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2517d7bf-b761-47ae-8c67-a95764cb29db tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.297553 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5ef288a4-0ca7-4126-a3dd-9940c49ceffd tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:27.299859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5ef288a4-0ca7-4126-a3dd-9940c49ceffd tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:27.313086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5ef288a4-0ca7-4126-a3dd-9940c49ceffd tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.313633 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5ef288a4-0ca7-4126-a3dd-9940c49ceffd tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.314527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5ef288a4-0ca7-4126-a3dd-9940c49ceffd tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.315160 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5ef288a4-0ca7-4126-a3dd-9940c49ceffd tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.352164 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2517d7bf-b761-47ae-8c67-a95764cb29db tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:27.362676 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2517d7bf-b761-47ae-8c67-a95764cb29db tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.197078 Jun 07 13:26:27.363312 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 449/871] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:27 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:27.396697 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5ef288a4-0ca7-4126-a3dd-9940c49ceffd tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:27.404338 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5ef288a4-0ca7-4126-a3dd-9940c49ceffd tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1328 microversion: 2.1 time: 0.115932 Jun 07 13:26:27.413700 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 423/872] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:27 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:28.018441 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e57abceb-f9bf-454c-8f42-3936d4ff97de tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:28.020495 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e57abceb-f9bf-454c-8f42-3936d4ff97de tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:28.031869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e57abceb-f9bf-454c-8f42-3936d4ff97de tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.032399 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e57abceb-f9bf-454c-8f42-3936d4ff97de tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.033276 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e57abceb-f9bf-454c-8f42-3936d4ff97de tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.033786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e57abceb-f9bf-454c-8f42-3936d4ff97de tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.272082 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-942bc6f3-58e3-41b0-9523-88d67d5a62b7 req-d9c2cc1c-a400-4244-9487-63d84a7f0e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6713415a-0881-4a58-990a-a2f14225eb3a", "name": "network-vif-plugged", "status": "completed", "tag": "c9751bb1-523a-4bf5-99a9-3905114fd3ac"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:28.285660 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e57abceb-f9bf-454c-8f42-3936d4ff97de tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:28.286564 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-942bc6f3-58e3-41b0-9523-88d67d5a62b7 req-d9c2cc1c-a400-4244-9487-63d84a7f0e2e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.287452 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-942bc6f3-58e3-41b0-9523-88d67d5a62b7 req-d9c2cc1c-a400-4244-9487-63d84a7f0e2e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.300477 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e57abceb-f9bf-454c-8f42-3936d4ff97de tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.298631 Jun 07 13:26:28.302024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 450/873] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:28 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:28.311616 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-942bc6f3-58e3-41b0-9523-88d67d5a62b7 req-d9c2cc1c-a400-4244-9487-63d84a7f0e2e service nova] Creating event network-vif-plugged:c9751bb1-523a-4bf5-99a9-3905114fd3ac for instance 6713415a-0881-4a58-990a-a2f14225eb3a on hv-cinder-84460 Jun 07 13:26:28.330129 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-942bc6f3-58e3-41b0-9523-88d67d5a62b7 req-d9c2cc1c-a400-4244-9487-63d84a7f0e2e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062467 Jun 07 13:26:28.331898 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 424/874] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:26:28.380052 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c0cb61b6-2144-4af7-b45f-946ea5944344 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:28.380810 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c0cb61b6-2144-4af7-b45f-946ea5944344 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:28.394979 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c0cb61b6-2144-4af7-b45f-946ea5944344 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.395965 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c0cb61b6-2144-4af7-b45f-946ea5944344 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.396967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c0cb61b6-2144-4af7-b45f-946ea5944344 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.398283 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c0cb61b6-2144-4af7-b45f-946ea5944344 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.422528 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f71e1b87-eedc-4b1a-8965-c88cfacace8f tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:28.423593 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f71e1b87-eedc-4b1a-8965-c88cfacace8f tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:28.430310 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f71e1b87-eedc-4b1a-8965-c88cfacace8f tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.431118 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f71e1b87-eedc-4b1a-8965-c88cfacace8f tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.432109 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f71e1b87-eedc-4b1a-8965-c88cfacace8f tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.432742 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f71e1b87-eedc-4b1a-8965-c88cfacace8f tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.821801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c0cb61b6-2144-4af7-b45f-946ea5944344 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:28.833089 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c0cb61b6-2144-4af7-b45f-946ea5944344 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.457210 Jun 07 13:26:28.842911 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 451/875] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:28 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:28.875499 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f71e1b87-eedc-4b1a-8965-c88cfacace8f tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:28.883466 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f71e1b87-eedc-4b1a-8965-c88cfacace8f tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.465646 Jun 07 13:26:28.884152 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 425/876] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:28 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:29.318381 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-45a80a1a-6852-4214-a3d6-74eaaa8a48c8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:29.319081 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-45a80a1a-6852-4214-a3d6-74eaaa8a48c8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:29.325240 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-45a80a1a-6852-4214-a3d6-74eaaa8a48c8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:29.326180 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-45a80a1a-6852-4214-a3d6-74eaaa8a48c8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:29.326965 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-45a80a1a-6852-4214-a3d6-74eaaa8a48c8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:29.327405 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-45a80a1a-6852-4214-a3d6-74eaaa8a48c8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:29.470184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-45a80a1a-6852-4214-a3d6-74eaaa8a48c8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:29.479075 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-45a80a1a-6852-4214-a3d6-74eaaa8a48c8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.164647 Jun 07 13:26:29.479659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 452/877] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:29 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:29.851882 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-089e63d6-4741-4efe-ac25-bc9706bf9e31 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:29.852482 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-089e63d6-4741-4efe-ac25-bc9706bf9e31 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:29.859003 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-089e63d6-4741-4efe-ac25-bc9706bf9e31 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:29.859455 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-089e63d6-4741-4efe-ac25-bc9706bf9e31 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:29.860209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-089e63d6-4741-4efe-ac25-bc9706bf9e31 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:29.860638 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-089e63d6-4741-4efe-ac25-bc9706bf9e31 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:29.901692 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c68c7c48-7e50-47bf-b141-e28e57d0c40a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:29.902506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c68c7c48-7e50-47bf-b141-e28e57d0c40a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:29.909043 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c68c7c48-7e50-47bf-b141-e28e57d0c40a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:29.909490 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c68c7c48-7e50-47bf-b141-e28e57d0c40a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:29.910295 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c68c7c48-7e50-47bf-b141-e28e57d0c40a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:29.910727 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c68c7c48-7e50-47bf-b141-e28e57d0c40a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:30.039013 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-089e63d6-4741-4efe-ac25-bc9706bf9e31 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:30.047901 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-089e63d6-4741-4efe-ac25-bc9706bf9e31 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.199767 Jun 07 13:26:30.058669 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 426/878] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:29 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:30.085757 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c68c7c48-7e50-47bf-b141-e28e57d0c40a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:30.093372 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c68c7c48-7e50-47bf-b141-e28e57d0c40a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.196244 Jun 07 13:26:30.093951 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 453/879] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:29 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:30.495582 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d38d1423-e766-43c8-bc3d-f2389f34b279 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:30.496248 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d38d1423-e766-43c8-bc3d-f2389f34b279 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:30.502524 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d38d1423-e766-43c8-bc3d-f2389f34b279 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:30.503026 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d38d1423-e766-43c8-bc3d-f2389f34b279 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:30.503791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d38d1423-e766-43c8-bc3d-f2389f34b279 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:30.504229 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d38d1423-e766-43c8-bc3d-f2389f34b279 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:30.641452 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d38d1423-e766-43c8-bc3d-f2389f34b279 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:30.648772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d38d1423-e766-43c8-bc3d-f2389f34b279 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.157079 Jun 07 13:26:30.649339 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 427/880] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:30 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:31.066197 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5a05451e-b378-4b3e-871e-8ef96421bdc8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:31.066805 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5a05451e-b378-4b3e-871e-8ef96421bdc8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:31.068807 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:31.074491 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5a05451e-b378-4b3e-871e-8ef96421bdc8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.075044 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5a05451e-b378-4b3e-871e-8ef96421bdc8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.076495 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5a05451e-b378-4b3e-871e-8ef96421bdc8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.076929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5a05451e-b378-4b3e-871e-8ef96421bdc8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.111428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a9d0706d-f1ab-4420-bce8-63e4fc4b9a02 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:31.113325 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a9d0706d-f1ab-4420-bce8-63e4fc4b9a02 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:31.125241 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a9d0706d-f1ab-4420-bce8-63e4fc4b9a02 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.125961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a9d0706d-f1ab-4420-bce8-63e4fc4b9a02 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.126965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a9d0706d-f1ab-4420-bce8-63e4fc4b9a02 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.127602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a9d0706d-f1ab-4420-bce8-63e4fc4b9a02 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.280377 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5a05451e-b378-4b3e-871e-8ef96421bdc8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:31.290214 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5a05451e-b378-4b3e-871e-8ef96421bdc8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.227726 Jun 07 13:26:31.290801 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 454/881] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:31 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:31.302431 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a9d0706d-f1ab-4420-bce8-63e4fc4b9a02 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:31.310522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a9d0706d-f1ab-4420-bce8-63e4fc4b9a02 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.203791 Jun 07 13:26:31.311127 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 428/882] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:31 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:31.666539 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7e50319e-763c-4991-9ad5-efc3ffdd0761 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:31.667184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7e50319e-763c-4991-9ad5-efc3ffdd0761 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:31.673796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e50319e-763c-4991-9ad5-efc3ffdd0761 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.674488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e50319e-763c-4991-9ad5-efc3ffdd0761 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.675285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e50319e-763c-4991-9ad5-efc3ffdd0761 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.675731 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7e50319e-763c-4991-9ad5-efc3ffdd0761 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.816781 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7e50319e-763c-4991-9ad5-efc3ffdd0761 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:31.824193 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7e50319e-763c-4991-9ad5-efc3ffdd0761 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.161505 Jun 07 13:26:31.824759 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 455/883] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:31 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:32.307352 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-10bd851b-8f3a-41f1-bc01-c095188b306d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:32.307904 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-10bd851b-8f3a-41f1-bc01-c095188b306d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:32.316277 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10bd851b-8f3a-41f1-bc01-c095188b306d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:32.317521 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10bd851b-8f3a-41f1-bc01-c095188b306d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:32.319797 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10bd851b-8f3a-41f1-bc01-c095188b306d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:32.321224 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10bd851b-8f3a-41f1-bc01-c095188b306d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:32.328493 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cb2e3bef-573a-4d96-af74-0b833089b95a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:32.329116 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-cb2e3bef-573a-4d96-af74-0b833089b95a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:32.337232 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cb2e3bef-573a-4d96-af74-0b833089b95a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:32.337958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cb2e3bef-573a-4d96-af74-0b833089b95a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:32.338743 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cb2e3bef-573a-4d96-af74-0b833089b95a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:32.339229 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cb2e3bef-573a-4d96-af74-0b833089b95a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:32.532851 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-10bd851b-8f3a-41f1-bc01-c095188b306d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:32.539624 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-cb2e3bef-573a-4d96-af74-0b833089b95a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:32.543063 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-10bd851b-8f3a-41f1-bc01-c095188b306d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.239557 Jun 07 13:26:32.547413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-cb2e3bef-573a-4d96-af74-0b833089b95a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.223478 Jun 07 13:26:32.547955 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 429/884] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:32 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:32.548074 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 456/885] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:32 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:32.841139 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6d77e570-822e-4022-bec4-d46d22de89ea tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:32.841750 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6d77e570-822e-4022-bec4-d46d22de89ea tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:32.847720 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6d77e570-822e-4022-bec4-d46d22de89ea tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:32.848162 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6d77e570-822e-4022-bec4-d46d22de89ea tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:32.848912 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6d77e570-822e-4022-bec4-d46d22de89ea tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:32.849349 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6d77e570-822e-4022-bec4-d46d22de89ea tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:32.990007 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6d77e570-822e-4022-bec4-d46d22de89ea tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:32.998053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6d77e570-822e-4022-bec4-d46d22de89ea tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.160191 Jun 07 13:26:32.998615 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 430/886] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:32 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:33.563472 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-745753f2-42cf-4782-84d4-d1faae063912 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:33.564076 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-745753f2-42cf-4782-84d4-d1faae063912 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:33.565704 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-75e2e9ff-f8df-44b6-8c49-89b9a1d4c8e1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:33.566351 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-75e2e9ff-f8df-44b6-8c49-89b9a1d4c8e1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:33.571129 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-745753f2-42cf-4782-84d4-d1faae063912 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:33.571837 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-745753f2-42cf-4782-84d4-d1faae063912 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:33.572630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-745753f2-42cf-4782-84d4-d1faae063912 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:33.573078 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-745753f2-42cf-4782-84d4-d1faae063912 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:33.574577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-75e2e9ff-f8df-44b6-8c49-89b9a1d4c8e1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:33.575065 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-75e2e9ff-f8df-44b6-8c49-89b9a1d4c8e1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:33.575844 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-75e2e9ff-f8df-44b6-8c49-89b9a1d4c8e1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:33.576283 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-75e2e9ff-f8df-44b6-8c49-89b9a1d4c8e1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:33.799280 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-75e2e9ff-f8df-44b6-8c49-89b9a1d4c8e1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:33.802063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-745753f2-42cf-4782-84d4-d1faae063912 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:33.806892 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-75e2e9ff-f8df-44b6-8c49-89b9a1d4c8e1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.245996 Jun 07 13:26:33.807638 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 431/887] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:33 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:33.810526 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-745753f2-42cf-4782-84d4-d1faae063912 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.250174 Jun 07 13:26:33.811203 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 457/888] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:33 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:34.014566 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4f0ad0ee-5c4b-44ad-aa3d-08c0ea01d2bc tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:34.015540 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4f0ad0ee-5c4b-44ad-aa3d-08c0ea01d2bc tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:34.022813 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f0ad0ee-5c4b-44ad-aa3d-08c0ea01d2bc tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:34.023656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f0ad0ee-5c4b-44ad-aa3d-08c0ea01d2bc tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:34.025015 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f0ad0ee-5c4b-44ad-aa3d-08c0ea01d2bc tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:34.025794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4f0ad0ee-5c4b-44ad-aa3d-08c0ea01d2bc tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:34.160401 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4f0ad0ee-5c4b-44ad-aa3d-08c0ea01d2bc tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:34.167732 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4f0ad0ee-5c4b-44ad-aa3d-08c0ea01d2bc tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.156999 Jun 07 13:26:34.168293 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 432/889] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:34 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:34.824435 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b3caf4cd-b0bc-417a-a8fa-d2ed37aebebc tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:34.825175 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b3caf4cd-b0bc-417a-a8fa-d2ed37aebebc tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:34.827838 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-12d2a193-611b-4511-a84e-db94bdeacc4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:34.828455 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-12d2a193-611b-4511-a84e-db94bdeacc4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:34.832090 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b3caf4cd-b0bc-417a-a8fa-d2ed37aebebc tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:34.832548 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b3caf4cd-b0bc-417a-a8fa-d2ed37aebebc tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:34.833336 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b3caf4cd-b0bc-417a-a8fa-d2ed37aebebc tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:34.833779 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b3caf4cd-b0bc-417a-a8fa-d2ed37aebebc tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:34.835391 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-12d2a193-611b-4511-a84e-db94bdeacc4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:34.835843 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-12d2a193-611b-4511-a84e-db94bdeacc4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:34.836643 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-12d2a193-611b-4511-a84e-db94bdeacc4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:34.837082 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-12d2a193-611b-4511-a84e-db94bdeacc4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:35.027558 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-12d2a193-611b-4511-a84e-db94bdeacc4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:35.036144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-12d2a193-611b-4511-a84e-db94bdeacc4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.212545 Jun 07 13:26:35.037123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 433/890] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:34 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:35.037887 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b3caf4cd-b0bc-417a-a8fa-d2ed37aebebc tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:35.045716 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b3caf4cd-b0bc-417a-a8fa-d2ed37aebebc tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.225079 Jun 07 13:26:35.046292 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 458/891] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:34 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:35.184810 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-68d5d5e3-28c9-4f23-aee2-34b8fe5b5b29 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:35.185479 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-68d5d5e3-28c9-4f23-aee2-34b8fe5b5b29 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:35.188112 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:35.188862 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=12 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:35.195049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-68d5d5e3-28c9-4f23-aee2-34b8fe5b5b29 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:35.195505 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-68d5d5e3-28c9-4f23-aee2-34b8fe5b5b29 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:35.196274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-68d5d5e3-28c9-4f23-aee2-34b8fe5b5b29 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:35.196709 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-68d5d5e3-28c9-4f23-aee2-34b8fe5b5b29 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:35.332243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-68d5d5e3-28c9-4f23-aee2-34b8fe5b5b29 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:35.342773 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-68d5d5e3-28c9-4f23-aee2-34b8fe5b5b29 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.161750 Jun 07 13:26:35.352811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 434/892] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:35 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:36.052476 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fac52a88-bf28-4156-9fea-b398d53cc4fb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:36.053091 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fac52a88-bf28-4156-9fea-b398d53cc4fb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:36.059289 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fac52a88-bf28-4156-9fea-b398d53cc4fb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:36.059755 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fac52a88-bf28-4156-9fea-b398d53cc4fb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:36.060546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fac52a88-bf28-4156-9fea-b398d53cc4fb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:36.060990 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fac52a88-bf28-4156-9fea-b398d53cc4fb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:36.064677 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d1243e8e-f9e3-40d8-8bf7-17e463e5cf99 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:36.065656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d1243e8e-f9e3-40d8-8bf7-17e463e5cf99 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:36.073520 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d1243e8e-f9e3-40d8-8bf7-17e463e5cf99 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:36.074136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d1243e8e-f9e3-40d8-8bf7-17e463e5cf99 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:36.075034 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d1243e8e-f9e3-40d8-8bf7-17e463e5cf99 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:36.075733 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d1243e8e-f9e3-40d8-8bf7-17e463e5cf99 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:36.110373 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=100 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:36.277909 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=8 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:36.284109 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fac52a88-bf28-4156-9fea-b398d53cc4fb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:36.292740 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d1243e8e-f9e3-40d8-8bf7-17e463e5cf99 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:36.293887 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fac52a88-bf28-4156-9fea-b398d53cc4fb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.245142 Jun 07 13:26:36.294486 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 459/893] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:36 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:36.303417 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d1243e8e-f9e3-40d8-8bf7-17e463e5cf99 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.242288 Jun 07 13:26:36.304007 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 435/894] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:36 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:36.360205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e9a26db0-3d3f-4752-b295-1ffa63a3773d tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:36.360874 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e9a26db0-3d3f-4752-b295-1ffa63a3773d tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:36.367607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e9a26db0-3d3f-4752-b295-1ffa63a3773d tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:36.368092 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e9a26db0-3d3f-4752-b295-1ffa63a3773d tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:36.368907 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e9a26db0-3d3f-4752-b295-1ffa63a3773d tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:36.369351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e9a26db0-3d3f-4752-b295-1ffa63a3773d tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:36.502526 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e9a26db0-3d3f-4752-b295-1ffa63a3773d tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:36.509939 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e9a26db0-3d3f-4752-b295-1ffa63a3773d tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.154223 Jun 07 13:26:36.510499 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 460/895] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:36 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:37.311071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fa446f65-7412-43ea-9a52-e7bb9efac0f3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:37.311821 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fa446f65-7412-43ea-9a52-e7bb9efac0f3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:37.318719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa446f65-7412-43ea-9a52-e7bb9efac0f3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.319204 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa446f65-7412-43ea-9a52-e7bb9efac0f3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:37.319978 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa446f65-7412-43ea-9a52-e7bb9efac0f3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.320418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa446f65-7412-43ea-9a52-e7bb9efac0f3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:37.320541 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9b57720b-d888-4c54-939b-a8460226e605 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:37.321147 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9b57720b-d888-4c54-939b-a8460226e605 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:37.327157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9b57720b-d888-4c54-939b-a8460226e605 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.327605 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9b57720b-d888-4c54-939b-a8460226e605 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:37.328362 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9b57720b-d888-4c54-939b-a8460226e605 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.328795 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9b57720b-d888-4c54-939b-a8460226e605 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:37.528499 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fa446f65-7412-43ea-9a52-e7bb9efac0f3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:37.529812 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9b57720b-d888-4c54-939b-a8460226e605 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:37.539245 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fa446f65-7412-43ea-9a52-e7bb9efac0f3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1674 microversion: 2.1 time: 0.231960 Jun 07 13:26:37.539450 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9b57720b-d888-4c54-939b-a8460226e605 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.222757 Jun 07 13:26:37.539984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 436/896] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:37 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1674 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:37.540639 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 461/897] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:37 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:37.545012 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8ca8fdf5-b904-4f8a-99b5-5df08f069735 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:37.545799 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8ca8fdf5-b904-4f8a-99b5-5df08f069735 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:37.551918 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8ca8fdf5-b904-4f8a-99b5-5df08f069735 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.552369 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8ca8fdf5-b904-4f8a-99b5-5df08f069735 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:37.553160 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8ca8fdf5-b904-4f8a-99b5-5df08f069735 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.553595 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8ca8fdf5-b904-4f8a-99b5-5df08f069735 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:37.683060 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8ca8fdf5-b904-4f8a-99b5-5df08f069735 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:37.690940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8ca8fdf5-b904-4f8a-99b5-5df08f069735 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.149838 Jun 07 13:26:37.691493 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 437/898] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:37 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:38.089786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-6e0a12ca-2e1a-452c-b737-ced88c43e5db req-fd9448dc-94f1-4acc-a895-60346e9260f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5973b7d3-2066-44b6-926a-4c4cefe97e9a", "tag": "bed14a51-6d9f-4196-acb1-a90c45346c0d"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:38.098058 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-6e0a12ca-2e1a-452c-b737-ced88c43e5db req-fd9448dc-94f1-4acc-a895-60346e9260f6 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.098821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-6e0a12ca-2e1a-452c-b737-ced88c43e5db req-fd9448dc-94f1-4acc-a895-60346e9260f6 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.115430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-6e0a12ca-2e1a-452c-b737-ced88c43e5db req-fd9448dc-94f1-4acc-a895-60346e9260f6 service nova] Creating event network-changed:bed14a51-6d9f-4196-acb1-a90c45346c0d for instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a on hv-cinder-84460 Jun 07 13:26:38.120936 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-6e0a12ca-2e1a-452c-b737-ced88c43e5db req-fd9448dc-94f1-4acc-a895-60346e9260f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034773 Jun 07 13:26:38.121712 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 462/899] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:38.556342 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-57deefba-9f18-498f-a35a-0d455e44e9b6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:38.556958 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-57deefba-9f18-498f-a35a-0d455e44e9b6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:38.561980 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b134a598-f416-4760-bd24-d27ea3db6ba8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:38.562682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b134a598-f416-4760-bd24-d27ea3db6ba8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:38.563576 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-57deefba-9f18-498f-a35a-0d455e44e9b6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.564028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-57deefba-9f18-498f-a35a-0d455e44e9b6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.564795 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-57deefba-9f18-498f-a35a-0d455e44e9b6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.565521 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-57deefba-9f18-498f-a35a-0d455e44e9b6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.568932 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b134a598-f416-4760-bd24-d27ea3db6ba8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.569395 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b134a598-f416-4760-bd24-d27ea3db6ba8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.570178 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b134a598-f416-4760-bd24-d27ea3db6ba8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.570637 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b134a598-f416-4760-bd24-d27ea3db6ba8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.770100 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-57deefba-9f18-498f-a35a-0d455e44e9b6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:38.778117 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-57deefba-9f18-498f-a35a-0d455e44e9b6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1651 microversion: 2.1 time: 0.225733 Jun 07 13:26:38.779303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 438/900] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:38 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1651 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:38.782118 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b134a598-f416-4760-bd24-d27ea3db6ba8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:38.785151 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2299dd05-9610-4363-89e8-9d4dcc02b0c5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:38.786110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2299dd05-9610-4363-89e8-9d4dcc02b0c5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:38.793006 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b134a598-f416-4760-bd24-d27ea3db6ba8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.240277 Jun 07 13:26:38.793219 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2299dd05-9610-4363-89e8-9d4dcc02b0c5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.793460 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2299dd05-9610-4363-89e8-9d4dcc02b0c5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.793918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 463/901] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:38 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:38.803602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2299dd05-9610-4363-89e8-9d4dcc02b0c5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.804054 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2299dd05-9610-4363-89e8-9d4dcc02b0c5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.806414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9af93c1b-d6d3-46e7-babb-048ce85b83b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:38.806969 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=100 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:38.812812 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9af93c1b-d6d3-46e7-babb-048ce85b83b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.813326 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9af93c1b-d6d3-46e7-babb-048ce85b83b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.834928 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9af93c1b-d6d3-46e7-babb-048ce85b83b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Going to try to start instance {{(pid=117843) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 13:26:38.878716 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9af93c1b-d6d3-46e7-babb-048ce85b83b4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/action" status: 202 len: 0 microversion: 2.1 time: 0.083454 Jun 07 13:26:38.879499 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 464/902] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:26:38 2022] POST /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:26:38.887811 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d6c6b3cc-2ead-42cb-97a0-7f0767b12831 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:38.888773 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d6c6b3cc-2ead-42cb-97a0-7f0767b12831 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:38.896755 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d6c6b3cc-2ead-42cb-97a0-7f0767b12831 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.897414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d6c6b3cc-2ead-42cb-97a0-7f0767b12831 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.898415 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d6c6b3cc-2ead-42cb-97a0-7f0767b12831 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:38.899052 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d6c6b3cc-2ead-42cb-97a0-7f0767b12831 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.983933 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2299dd05-9610-4363-89e8-9d4dcc02b0c5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:38.991537 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2299dd05-9610-4363-89e8-9d4dcc02b0c5 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1317 microversion: 2.1 time: 0.210488 Jun 07 13:26:38.992107 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 439/903] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:38 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:39.044918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d6c6b3cc-2ead-42cb-97a0-7f0767b12831 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:39.052542 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d6c6b3cc-2ead-42cb-97a0-7f0767b12831 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1660 microversion: 2.1 time: 0.168843 Jun 07 13:26:39.053108 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 465/904] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:38 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1660 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:39.810141 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5455daf1-9942-4d93-84af-1933dc1df742 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:39.810782 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5455daf1-9942-4d93-84af-1933dc1df742 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:39.817780 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5455daf1-9942-4d93-84af-1933dc1df742 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:39.818231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5455daf1-9942-4d93-84af-1933dc1df742 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:39.819004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5455daf1-9942-4d93-84af-1933dc1df742 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:39.819440 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5455daf1-9942-4d93-84af-1933dc1df742 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:39.944636 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5455daf1-9942-4d93-84af-1933dc1df742 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:39.952019 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5455daf1-9942-4d93-84af-1933dc1df742 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.145716 Jun 07 13:26:39.952587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 440/905] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:39 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:40.008020 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f48028b1-cc85-4cea-8b08-8ca0a929fbf1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:40.008639 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f48028b1-cc85-4cea-8b08-8ca0a929fbf1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:40.014554 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f48028b1-cc85-4cea-8b08-8ca0a929fbf1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.015047 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f48028b1-cc85-4cea-8b08-8ca0a929fbf1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:40.015810 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f48028b1-cc85-4cea-8b08-8ca0a929fbf1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.016247 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f48028b1-cc85-4cea-8b08-8ca0a929fbf1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:40.069731 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6027fc94-c735-4c84-981d-fdc8dcf7453f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:40.070250 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6027fc94-c735-4c84-981d-fdc8dcf7453f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:40.076303 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6027fc94-c735-4c84-981d-fdc8dcf7453f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.076753 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6027fc94-c735-4c84-981d-fdc8dcf7453f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:40.077518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6027fc94-c735-4c84-981d-fdc8dcf7453f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.077954 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6027fc94-c735-4c84-981d-fdc8dcf7453f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:40.184173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f48028b1-cc85-4cea-8b08-8ca0a929fbf1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:40.191703 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f48028b1-cc85-4cea-8b08-8ca0a929fbf1 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1507 microversion: 2.1 time: 0.187442 Jun 07 13:26:40.192286 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 466/906] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:40 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:40.227462 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6027fc94-c735-4c84-981d-fdc8dcf7453f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:40.236254 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6027fc94-c735-4c84-981d-fdc8dcf7453f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1660 microversion: 2.1 time: 0.170002 Jun 07 13:26:40.236447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 441/907] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:40 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1660 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:40.968700 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ba4c34ea-b6dc-4b55-8529-7eeafb51b818 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:40.969385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ba4c34ea-b6dc-4b55-8529-7eeafb51b818 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:40.975735 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ba4c34ea-b6dc-4b55-8529-7eeafb51b818 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.976190 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ba4c34ea-b6dc-4b55-8529-7eeafb51b818 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:40.976964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ba4c34ea-b6dc-4b55-8529-7eeafb51b818 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.977408 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ba4c34ea-b6dc-4b55-8529-7eeafb51b818 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:41.114413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ba4c34ea-b6dc-4b55-8529-7eeafb51b818 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:41.122744 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ba4c34ea-b6dc-4b55-8529-7eeafb51b818 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.157991 Jun 07 13:26:41.123363 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 467/908] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:40 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:41.253372 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e2a69447-cf84-412c-b132-fd8db828d4d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:41.253994 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e2a69447-cf84-412c-b132-fd8db828d4d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:41.260749 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2a69447-cf84-412c-b132-fd8db828d4d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:41.261271 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2a69447-cf84-412c-b132-fd8db828d4d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:41.262062 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2a69447-cf84-412c-b132-fd8db828d4d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:41.262493 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2a69447-cf84-412c-b132-fd8db828d4d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:41.393300 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e2a69447-cf84-412c-b132-fd8db828d4d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:41.401283 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e2a69447-cf84-412c-b132-fd8db828d4d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1660 microversion: 2.1 time: 0.151710 Jun 07 13:26:41.402168 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 442/909] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:41 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1660 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:42.139868 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6dd5d258-15d0-413b-b85e-2a5ecc7865d9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:42.140531 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6dd5d258-15d0-413b-b85e-2a5ecc7865d9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:42.146493 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6dd5d258-15d0-413b-b85e-2a5ecc7865d9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:42.146977 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6dd5d258-15d0-413b-b85e-2a5ecc7865d9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:42.147737 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6dd5d258-15d0-413b-b85e-2a5ecc7865d9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:42.148176 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6dd5d258-15d0-413b-b85e-2a5ecc7865d9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:42.278927 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-6dd5d258-15d0-413b-b85e-2a5ecc7865d9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:42.286975 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6dd5d258-15d0-413b-b85e-2a5ecc7865d9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.150951 Jun 07 13:26:42.287556 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 468/910] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:42 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:42.419327 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d5a4c1d6-4716-43c8-b85d-fa7db097c78e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:42.419939 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d5a4c1d6-4716-43c8-b85d-fa7db097c78e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:42.427104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d5a4c1d6-4716-43c8-b85d-fa7db097c78e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:42.427554 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d5a4c1d6-4716-43c8-b85d-fa7db097c78e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:42.428319 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d5a4c1d6-4716-43c8-b85d-fa7db097c78e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:42.428748 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d5a4c1d6-4716-43c8-b85d-fa7db097c78e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:42.556797 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-d5a4c1d6-4716-43c8-b85d-fa7db097c78e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:42.564384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d5a4c1d6-4716-43c8-b85d-fa7db097c78e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1664 microversion: 2.1 time: 0.149011 Jun 07 13:26:42.564956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 443/911] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:42 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:43.305027 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5d58f369-6b4c-4788-a30d-16879dacd7f7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:43.305668 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5d58f369-6b4c-4788-a30d-16879dacd7f7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:43.312603 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5d58f369-6b4c-4788-a30d-16879dacd7f7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:43.313064 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5d58f369-6b4c-4788-a30d-16879dacd7f7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:43.313892 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5d58f369-6b4c-4788-a30d-16879dacd7f7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:43.314435 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5d58f369-6b4c-4788-a30d-16879dacd7f7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:43.444781 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5d58f369-6b4c-4788-a30d-16879dacd7f7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:43.452253 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5d58f369-6b4c-4788-a30d-16879dacd7f7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.151409 Jun 07 13:26:43.452821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 469/912] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:43 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:44.226997 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-347404fe-7f52-4abf-9d9b-960c65fcb1ed req-3e195bec-36ac-4952-afc1-06091e79081d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5973b7d3-2066-44b6-926a-4c4cefe97e9a", "name": "network-vif-plugged", "status": "completed", "tag": "bed14a51-6d9f-4196-acb1-a90c45346c0d"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:44.235744 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-347404fe-7f52-4abf-9d9b-960c65fcb1ed req-3e195bec-36ac-4952-afc1-06091e79081d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:44.236196 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-347404fe-7f52-4abf-9d9b-960c65fcb1ed req-3e195bec-36ac-4952-afc1-06091e79081d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:44.247380 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-347404fe-7f52-4abf-9d9b-960c65fcb1ed req-3e195bec-36ac-4952-afc1-06091e79081d service nova] Creating event network-vif-plugged:bed14a51-6d9f-4196-acb1-a90c45346c0d for instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a on hv-cinder-84460 Jun 07 13:26:44.252289 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-347404fe-7f52-4abf-9d9b-960c65fcb1ed req-3e195bec-36ac-4952-afc1-06091e79081d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028976 Jun 07 13:26:44.252873 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 444/913] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:44.469475 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-63866755-3f5d-4953-a81a-8d0708fdfa4a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:44.470076 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-63866755-3f5d-4953-a81a-8d0708fdfa4a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:44.476166 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-63866755-3f5d-4953-a81a-8d0708fdfa4a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:44.476620 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-63866755-3f5d-4953-a81a-8d0708fdfa4a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:44.477390 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-63866755-3f5d-4953-a81a-8d0708fdfa4a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:44.477824 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-63866755-3f5d-4953-a81a-8d0708fdfa4a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:44.773079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-63866755-3f5d-4953-a81a-8d0708fdfa4a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:44.780722 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-63866755-3f5d-4953-a81a-8d0708fdfa4a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.315657 Jun 07 13:26:44.781574 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 470/914] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:44 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:45.798466 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1044c230-d7f8-4858-a5b9-0cda22209bdf tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:45.799194 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1044c230-d7f8-4858-a5b9-0cda22209bdf tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:45.805534 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1044c230-d7f8-4858-a5b9-0cda22209bdf tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:45.805984 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1044c230-d7f8-4858-a5b9-0cda22209bdf tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:45.806745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1044c230-d7f8-4858-a5b9-0cda22209bdf tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:45.807218 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1044c230-d7f8-4858-a5b9-0cda22209bdf tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:45.934716 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1044c230-d7f8-4858-a5b9-0cda22209bdf tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:45.942983 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1044c230-d7f8-4858-a5b9-0cda22209bdf tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1358 microversion: 2.1 time: 0.149805 Jun 07 13:26:45.943556 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 445/915] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:45 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:46.960106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f527f8ca-301a-4921-925c-980d16d4e1a3 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:46.960723 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f527f8ca-301a-4921-925c-980d16d4e1a3 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:46.966893 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f527f8ca-301a-4921-925c-980d16d4e1a3 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:46.967342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f527f8ca-301a-4921-925c-980d16d4e1a3 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:46.968101 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f527f8ca-301a-4921-925c-980d16d4e1a3 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:46.968531 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f527f8ca-301a-4921-925c-980d16d4e1a3 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:47.096566 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f527f8ca-301a-4921-925c-980d16d4e1a3 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:47.104254 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f527f8ca-301a-4921-925c-980d16d4e1a3 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1548 microversion: 2.1 time: 0.147956 Jun 07 13:26:47.104816 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 471/916] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:46 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:47.122403 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-63f65fa4-3138-40ab-8ed0-82ef3d294c06 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:47.123061 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-63f65fa4-3138-40ab-8ed0-82ef3d294c06 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:47.129816 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-63f65fa4-3138-40ab-8ed0-82ef3d294c06 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:47.130262 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-63f65fa4-3138-40ab-8ed0-82ef3d294c06 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:47.131047 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-63f65fa4-3138-40ab-8ed0-82ef3d294c06 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:47.131485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-63f65fa4-3138-40ab-8ed0-82ef3d294c06 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:47.257859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-63f65fa4-3138-40ab-8ed0-82ef3d294c06 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:47.265769 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-63f65fa4-3138-40ab-8ed0-82ef3d294c06 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1548 microversion: 2.1 time: 0.147201 Jun 07 13:26:47.266343 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 446/917] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:47 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:47.281221 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-581e74fc-e12c-4841-8184-3920a558e767 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:47.284702 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-581e74fc-e12c-4841-8184-3920a558e767 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:47.285465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-581e74fc-e12c-4841-8184-3920a558e767 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Searching by: {'deleted': False, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd'} {{(pid=117843) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 13:26:47.292038 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-581e74fc-e12c-4841-8184-3920a558e767 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:47.292488 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-581e74fc-e12c-4841-8184-3920a558e767 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:47.293287 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-581e74fc-e12c-4841-8184-3920a558e767 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:47.293722 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-581e74fc-e12c-4841-8184-3920a558e767 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:47.383576 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.multi_cell_list [None req-581e74fc-e12c-4841-8184-3920a558e767 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 13:26:47.480679 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-581e74fc-e12c-4841-8184-3920a558e767 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203066 Jun 07 13:26:47.481327 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 472/918] 10.222.0.61 () {58 vars in 1124 bytes} [Tue Jun 7 13:26:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:47.502177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-4d772977-49a7-4a8d-8765-35a844a66440 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:47.502790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-4d772977-49a7-4a8d-8765-35a844a66440 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:47.508829 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4d772977-49a7-4a8d-8765-35a844a66440 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:47.509276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4d772977-49a7-4a8d-8765-35a844a66440 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:47.510030 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4d772977-49a7-4a8d-8765-35a844a66440 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:47.510464 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-4d772977-49a7-4a8d-8765-35a844a66440 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:47.638040 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-4d772977-49a7-4a8d-8765-35a844a66440 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:47.645788 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-4d772977-49a7-4a8d-8765-35a844a66440 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1548 microversion: 2.1 time: 0.147552 Jun 07 13:26:47.646362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 447/919] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:47 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:49.167501 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7503ba05-5856-4777-8573-d926ba1ded8d tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dfd626a-8007-4da8-b703-2af6f95dc545"}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:49.168741 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7503ba05-5856-4777-8573-d926ba1ded8d tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:49.175057 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7503ba05-5856-4777-8573-d926ba1ded8d tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:49.175507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7503ba05-5856-4777-8573-d926ba1ded8d tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:49.176273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7503ba05-5856-4777-8573-d926ba1ded8d tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:49.176705 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7503ba05-5856-4777-8573-d926ba1ded8d tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:49.410051 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:49.420220 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7503ba05-5856-4777-8573-d926ba1ded8d tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "POST /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256844 Jun 07 13:26:49.421150 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 473/920] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:26:49 2022] POST /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:56.955404 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-362a2f84-8b89-41ce-a1fa-328430459209 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:56.956028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-362a2f84-8b89-41ce-a1fa-328430459209 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:56.958646 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:56.964082 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-362a2f84-8b89-41ce-a1fa-328430459209 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:56.964539 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-362a2f84-8b89-41ce-a1fa-328430459209 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:56.965306 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-362a2f84-8b89-41ce-a1fa-328430459209 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:56.965745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-362a2f84-8b89-41ce-a1fa-328430459209 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:57.100872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-362a2f84-8b89-41ce-a1fa-328430459209 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:57.108769 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-362a2f84-8b89-41ce-a1fa-328430459209 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1594 microversion: 2.1 time: 0.157795 Jun 07 13:26:57.109341 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 448/921] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:56 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:58.994941 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:58.999701 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-f36f9da6-cb28-484c-949a-bb7e2aafa94f req-5ba23511-b072-440d-9e58-719b54810ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5973b7d3-2066-44b6-926a-4c4cefe97e9a", "tag": "bed14a51-6d9f-4196-acb1-a90c45346c0d"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:59.004080 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:59.011643 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f36f9da6-cb28-484c-949a-bb7e2aafa94f req-5ba23511-b072-440d-9e58-719b54810ffc service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:59.012115 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-f36f9da6-cb28-484c-949a-bb7e2aafa94f req-5ba23511-b072-440d-9e58-719b54810ffc service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:59.024547 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-f36f9da6-cb28-484c-949a-bb7e2aafa94f req-5ba23511-b072-440d-9e58-719b54810ffc service nova] Creating event network-changed:bed14a51-6d9f-4196-acb1-a90c45346c0d for instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a on hv-cinder-84460 Jun 07 13:26:59.029985 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-f36f9da6-cb28-484c-949a-bb7e2aafa94f req-5ba23511-b072-440d-9e58-719b54810ffc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036115 Jun 07 13:26:59.030520 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 474/922] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:59.516276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-852841de-083f-4029-906d-c981d7a70c17 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63402511-c75a-486c-9729-e14dc972e840", "device": "/dev/sdb"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:59.519559 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-852841de-083f-4029-906d-c981d7a70c17 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:59.527285 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-852841de-083f-4029-906d-c981d7a70c17 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:59.528169 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-852841de-083f-4029-906d-c981d7a70c17 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:59.529112 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-852841de-083f-4029-906d-c981d7a70c17 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:59.529713 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-852841de-083f-4029-906d-c981d7a70c17 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:59.843453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-852841de-083f-4029-906d-c981d7a70c17 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "POST /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331533 Jun 07 13:26:59.844945 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 449/923] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:26:59 2022] POST /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:27:00.128949 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2ed732ec-e1f7-4e75-b992-413e673a0ae0 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1146177753"}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:00.129632 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2ed732ec-e1f7-4e75-b992-413e673a0ae0 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:00.135997 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2ed732ec-e1f7-4e75-b992-413e673a0ae0 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:00.136459 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2ed732ec-e1f7-4e75-b992-413e673a0ae0 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:00.137227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2ed732ec-e1f7-4e75-b992-413e673a0ae0 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:00.137660 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2ed732ec-e1f7-4e75-b992-413e673a0ae0 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:00.275377 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.network.security_group_api [None req-2ed732ec-e1f7-4e75-b992-413e673a0ae0 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Adding security group dc49ce17-8053-4c2c-8297-12899710fcfb to port bed14a51-6d9f-4196-acb1-a90c45346c0d Jun 07 13:27:00.695240 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2ed732ec-e1f7-4e75-b992-413e673a0ae0 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "POST /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/action" status: 202 len: 0 microversion: 2.1 time: 0.571435 Jun 07 13:27:00.701958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 475/924] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:27:00 2022] POST /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:27:00.705498 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2a88b0eb-f60d-474f-838e-cfd48bd55b39 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:00.706211 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2a88b0eb-f60d-474f-838e-cfd48bd55b39 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:00.713706 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2a88b0eb-f60d-474f-838e-cfd48bd55b39 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:00.714666 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2a88b0eb-f60d-474f-838e-cfd48bd55b39 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:00.715767 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2a88b0eb-f60d-474f-838e-cfd48bd55b39 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:00.716433 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2a88b0eb-f60d-474f-838e-cfd48bd55b39 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:00.899244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2a88b0eb-f60d-474f-838e-cfd48bd55b39 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:00.907207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2a88b0eb-f60d-474f-838e-cfd48bd55b39 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1760 microversion: 2.1 time: 0.205942 Jun 07 13:27:00.908267 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 450/925] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:00 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1760 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:27:01.044565 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-4099cc25-29a8-4e8a-b5ab-c9508b6275e8 req-1eee0a02-c419-4a9d-bdaa-abed8b5ce66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5973b7d3-2066-44b6-926a-4c4cefe97e9a", "tag": "bed14a51-6d9f-4196-acb1-a90c45346c0d"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:01.052707 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-4099cc25-29a8-4e8a-b5ab-c9508b6275e8 req-1eee0a02-c419-4a9d-bdaa-abed8b5ce66e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:01.053236 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-4099cc25-29a8-4e8a-b5ab-c9508b6275e8 req-1eee0a02-c419-4a9d-bdaa-abed8b5ce66e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:01.064102 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-4099cc25-29a8-4e8a-b5ab-c9508b6275e8 req-1eee0a02-c419-4a9d-bdaa-abed8b5ce66e service nova] Creating event network-changed:bed14a51-6d9f-4196-acb1-a90c45346c0d for instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a on hv-cinder-84460 Jun 07 13:27:01.068773 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-4099cc25-29a8-4e8a-b5ab-c9508b6275e8 req-1eee0a02-c419-4a9d-bdaa-abed8b5ce66e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028281 Jun 07 13:27:01.069354 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 476/926] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:27:23.455125 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c871db69-e0fb-439f-8030-0bb2ed79d40a tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:23.455640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c871db69-e0fb-439f-8030-0bb2ed79d40a tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:23.458120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=5 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:23.459058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:23.464679 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c871db69-e0fb-439f-8030-0bb2ed79d40a tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:23.465133 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c871db69-e0fb-439f-8030-0bb2ed79d40a tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:23.465892 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c871db69-e0fb-439f-8030-0bb2ed79d40a tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:23.466331 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c871db69-e0fb-439f-8030-0bb2ed79d40a tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:23.547881 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-c871db69-e0fb-439f-8030-0bb2ed79d40a tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lazy-loading 'services' on Instance uuid 6713415a-0881-4a58-990a-a2f14225eb3a {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:27:23.618042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c871db69-e0fb-439f-8030-0bb2ed79d40a tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a/os-volume_attachments/63402511-c75a-486c-9729-e14dc972e840" status: 202 len: 0 microversion: 2.1 time: 0.167417 Jun 07 13:27:23.618622 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 451/927] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:27:23 2022] DELETE /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a/os-volume_attachments/63402511-c75a-486c-9729-e14dc972e840 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:27:24.734111 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=5 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:24.735053 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=8 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:24.739384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2c5e62f1-f9d6-47ce-b284-c0dda62a2217 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:24.739960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2c5e62f1-f9d6-47ce-b284-c0dda62a2217 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:24.747111 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2c5e62f1-f9d6-47ce-b284-c0dda62a2217 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:24.747560 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2c5e62f1-f9d6-47ce-b284-c0dda62a2217 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:24.748310 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2c5e62f1-f9d6-47ce-b284-c0dda62a2217 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:24.748744 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2c5e62f1-f9d6-47ce-b284-c0dda62a2217 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:24.777057 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2c5e62f1-f9d6-47ce-b284-c0dda62a2217 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:27:24.849089 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2c5e62f1-f9d6-47ce-b284-c0dda62a2217 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 204 len: 0 microversion: 2.1 time: 0.116169 Jun 07 13:27:24.849594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 477/928] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:27:24 2022] DELETE /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:27:24.858679 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-11558c59-146e-4cba-b652-6b1f2a4503e6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:24.859484 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-11558c59-146e-4cba-b652-6b1f2a4503e6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:24.865910 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11558c59-146e-4cba-b652-6b1f2a4503e6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:24.866360 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11558c59-146e-4cba-b652-6b1f2a4503e6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:24.867162 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11558c59-146e-4cba-b652-6b1f2a4503e6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:24.867593 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-11558c59-146e-4cba-b652-6b1f2a4503e6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:24.997191 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-11558c59-146e-4cba-b652-6b1f2a4503e6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:25.005551 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-11558c59-146e-4cba-b652-6b1f2a4503e6 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1513 microversion: 2.1 time: 0.151592 Jun 07 13:27:25.006136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 452/929] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:24 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:26.023309 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-39ebd2ae-20ce-4a4b-a4db-bc5f054a0e64 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:26.024015 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-39ebd2ae-20ce-4a4b-a4db-bc5f054a0e64 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:26.030473 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39ebd2ae-20ce-4a4b-a4db-bc5f054a0e64 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:26.030967 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39ebd2ae-20ce-4a4b-a4db-bc5f054a0e64 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:26.032345 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39ebd2ae-20ce-4a4b-a4db-bc5f054a0e64 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:26.032783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-39ebd2ae-20ce-4a4b-a4db-bc5f054a0e64 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:26.157995 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-39ebd2ae-20ce-4a4b-a4db-bc5f054a0e64 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:26.165411 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-39ebd2ae-20ce-4a4b-a4db-bc5f054a0e64 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1513 microversion: 2.1 time: 0.146407 Jun 07 13:27:26.165980 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 478/930] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:26 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:27.182255 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c39b745f-6649-470e-a583-afe2d84397d0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:27.182893 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c39b745f-6649-470e-a583-afe2d84397d0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:27.189398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c39b745f-6649-470e-a583-afe2d84397d0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:27.189850 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c39b745f-6649-470e-a583-afe2d84397d0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:27.190643 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c39b745f-6649-470e-a583-afe2d84397d0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:27.191101 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c39b745f-6649-470e-a583-afe2d84397d0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:27.321591 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c39b745f-6649-470e-a583-afe2d84397d0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:27.329679 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c39b745f-6649-470e-a583-afe2d84397d0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 200 len: 1513 microversion: 2.1 time: 0.151309 Jun 07 13:27:27.330745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 453/931] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:27 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:27.665966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-8b4bfd70-5a33-4fe9-93b1-2dfe30765606 req-fe0b0fca-d0a5-4f9c-9518-89fd0c0703f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6713415a-0881-4a58-990a-a2f14225eb3a", "name": "network-vif-deleted", "tag": "c9751bb1-523a-4bf5-99a9-3905114fd3ac"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:27.674492 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-8b4bfd70-5a33-4fe9-93b1-2dfe30765606 req-fe0b0fca-d0a5-4f9c-9518-89fd0c0703f0 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:27.675281 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-8b4bfd70-5a33-4fe9-93b1-2dfe30765606 req-fe0b0fca-d0a5-4f9c-9518-89fd0c0703f0 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:27.686417 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-8b4bfd70-5a33-4fe9-93b1-2dfe30765606 req-fe0b0fca-d0a5-4f9c-9518-89fd0c0703f0 service nova] Creating event network-vif-deleted:c9751bb1-523a-4bf5-99a9-3905114fd3ac for instance 6713415a-0881-4a58-990a-a2f14225eb3a on hv-cinder-84460 Jun 07 13:27:27.691845 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-8b4bfd70-5a33-4fe9-93b1-2dfe30765606 req-fe0b0fca-d0a5-4f9c-9518-89fd0c0703f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029496 Jun 07 13:27:27.692435 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 479/932] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:27:28.347215 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:28.347767 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 6713415a-0881-4a58-990a-a2f14225eb3a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:28.354152 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:28.354608 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:28.355466 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:28.355940 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:28.369883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] HTTP exception thrown: Instance 6713415a-0881-4a58-990a-a2f14225eb3a could not be found. Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Request method failure captured: Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a HTTP/1.1 Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1H6YJoUQZ1pKkG-j_c3YlNqf7-AsSwIkFcJGSTCLLwV3P445SsThL_VfSkooXtIdSf6ZEHVa4ykZ08MYLdpojc5KOKoYPodYwPRV2PDP1oUZYrMLg0NnvfTMz5Fzeu3uTEcCQO_KOh4ekViO1OT95F4hyU3Hqd9-xRzhbZUUc4ttk4 Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: a004938108be44fd8367b8fae5592613 Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-VolumesSnapshotTestJSON-780415391 Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:27:28.371522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a004938108be44fd8367b8fae5592613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a004938108be44fd8367b8fae5592613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a004938108be44fd8367b8fae5592613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a004938108be44fd8367b8fae5592613"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-VolumesSnapshotTestJSON-780415391 Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: a004938108be44fd8367b8fae5592613 Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-780415391 Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-VolumesSnapshotTestJSON-780415391-project Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 625ae02165844f9baa4d6672eafbb6d6 Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-VolumesSnapshotTestJSON-780415391-project Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 6713415a-0881-4a58-990a-a2f14225eb3a could not be found. Jun 07 13:27:28.373209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '6713415a-0881-4a58-990a-a2f14225eb3a'} Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6713415a-0881-4a58-990a-a2f14225eb3a could not be found. Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:27:28.374116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6713415a-0881-4a58-990a-a2f14225eb3a could not be found. Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6713415a-0881-4a58-990a-a2f14225eb3a could not be found. Jun 07 13:27:28.375715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:27:28.377437 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Returning 404 to user: Instance 6713415a-0881-4a58-990a-a2f14225eb3a could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:27:28.377437 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8ee1c4e1-fddf-4488-bde8-556f124dc781 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a" status: 404 len: 111 microversion: 2.1 time: 0.030284 Jun 07 13:27:28.377437 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 454/933] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:28 2022] GET /compute/v2.1/servers/6713415a-0881-4a58-990a-a2f14225eb3a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:27:38.160542 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:38.161265 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:38.165610 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-546065494", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "networks": [{"uuid": "749bef9f-ed8d-4079-86c1-f28336ec4a01"}]}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:38.216779 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] validate_networks() for [('749bef9f-ed8d-4079-86c1-f28336ec4a01', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:27:38.555842 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:27:38.556254 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:27:38.556725 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:27:38.557165 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:27:38.557597 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:27:38.567882 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:38.568341 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:38.569227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:38.569637 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:38.586141 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Getting quotas for project a004938108be44fd8367b8fae5592613. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:27:38.590166 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Getting quotas for user 625ae02165844f9baa4d6672eafbb6d6 and project a004938108be44fd8367b8fae5592613. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:27:38.600938 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:27:38.603309 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:27:38.647819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-02d5d56b-6048-49e1-af9e-ba3c08e7d511 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488757 Jun 07 13:27:38.648467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 480/934] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:27:38.658285 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-91089fb8-2dd4-4fef-b9be-ab9ff0ef8425 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:38.658920 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-91089fb8-2dd4-4fef-b9be-ab9ff0ef8425 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:38.661469 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=8 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:38.662108 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:38.717961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-91089fb8-2dd4-4fef-b9be-ab9ff0ef8425 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:38.727556 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-91089fb8-2dd4-4fef-b9be-ab9ff0ef8425 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1218 microversion: 2.1 time: 0.073006 Jun 07 13:27:38.728288 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 455/935] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:38 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:27:39.745525 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-94bee938-a2aa-4972-8693-9e7636e39f2f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:39.746146 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-94bee938-a2aa-4972-8693-9e7636e39f2f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:39.754157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-94bee938-a2aa-4972-8693-9e7636e39f2f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:39.754615 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-94bee938-a2aa-4972-8693-9e7636e39f2f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:39.755410 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-94bee938-a2aa-4972-8693-9e7636e39f2f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:39.755849 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-94bee938-a2aa-4972-8693-9e7636e39f2f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:39.816329 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-94bee938-a2aa-4972-8693-9e7636e39f2f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:39.823933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-94bee938-a2aa-4972-8693-9e7636e39f2f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1276 microversion: 2.1 time: 0.082708 Jun 07 13:27:39.824794 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 481/936] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:39 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1276 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:40.826614 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-6a53dbe5-4152-4eef-a5b9-11d105261fb9 req-88926a78-5513-4522-95df-c8e726f5c538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283b33da-e8e6-410d-ad5f-c2cf46a745f3", "tag": "4c14653f-ef76-4b3c-9ecd-883ef3aced8d"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:40.836374 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-6a53dbe5-4152-4eef-a5b9-11d105261fb9 req-88926a78-5513-4522-95df-c8e726f5c538 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:40.837422 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-6a53dbe5-4152-4eef-a5b9-11d105261fb9 req-88926a78-5513-4522-95df-c8e726f5c538 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:40.841897 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-18e8779a-6ca2-4007-87f4-ca7347eb385f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:40.843149 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-18e8779a-6ca2-4007-87f4-ca7347eb385f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:40.852594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-18e8779a-6ca2-4007-87f4-ca7347eb385f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:40.853121 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-18e8779a-6ca2-4007-87f4-ca7347eb385f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:40.853890 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-18e8779a-6ca2-4007-87f4-ca7347eb385f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:40.854552 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-18e8779a-6ca2-4007-87f4-ca7347eb385f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:40.859754 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-6a53dbe5-4152-4eef-a5b9-11d105261fb9 req-88926a78-5513-4522-95df-c8e726f5c538 service nova] Creating event network-changed:4c14653f-ef76-4b3c-9ecd-883ef3aced8d for instance 283b33da-e8e6-410d-ad5f-c2cf46a745f3 on hv-cinder-84460 Jun 07 13:27:40.866051 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-6a53dbe5-4152-4eef-a5b9-11d105261fb9 req-88926a78-5513-4522-95df-c8e726f5c538 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043345 Jun 07 13:27:40.866871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 456/937] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:27:40.986741 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-18e8779a-6ca2-4007-87f4-ca7347eb385f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:40.994413 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-18e8779a-6ca2-4007-87f4-ca7347eb385f tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1318 microversion: 2.1 time: 0.156524 Jun 07 13:27:40.995024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 482/938] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:40 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:42.011922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8d560c60-715f-493a-a6ba-42ce17f771cb tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:42.012617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8d560c60-715f-493a-a6ba-42ce17f771cb tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:42.018785 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d560c60-715f-493a-a6ba-42ce17f771cb tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:42.019339 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d560c60-715f-493a-a6ba-42ce17f771cb tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:42.020126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d560c60-715f-493a-a6ba-42ce17f771cb tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:42.020566 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d560c60-715f-493a-a6ba-42ce17f771cb tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:42.149030 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8d560c60-715f-493a-a6ba-42ce17f771cb tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:42.156968 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8d560c60-715f-493a-a6ba-42ce17f771cb tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1318 microversion: 2.1 time: 0.149785 Jun 07 13:27:42.157537 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 457/939] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:42 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:43.173899 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-edf938e1-bc07-4e64-a253-1e5b89fd9932 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:43.174497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-edf938e1-bc07-4e64-a253-1e5b89fd9932 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:43.180911 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-edf938e1-bc07-4e64-a253-1e5b89fd9932 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:43.181359 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-edf938e1-bc07-4e64-a253-1e5b89fd9932 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:43.182113 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-edf938e1-bc07-4e64-a253-1e5b89fd9932 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:43.182543 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-edf938e1-bc07-4e64-a253-1e5b89fd9932 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:43.311033 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-edf938e1-bc07-4e64-a253-1e5b89fd9932 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:43.319109 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-edf938e1-bc07-4e64-a253-1e5b89fd9932 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1318 microversion: 2.1 time: 0.149508 Jun 07 13:27:43.319690 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 483/940] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:43 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:44.336504 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cfc64c70-7030-492c-ba92-62ad708fab88 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:44.337115 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cfc64c70-7030-492c-ba92-62ad708fab88 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:44.344145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cfc64c70-7030-492c-ba92-62ad708fab88 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:44.344658 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cfc64c70-7030-492c-ba92-62ad708fab88 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:44.345562 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cfc64c70-7030-492c-ba92-62ad708fab88 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:44.346000 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cfc64c70-7030-492c-ba92-62ad708fab88 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:44.482462 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-cfc64c70-7030-492c-ba92-62ad708fab88 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:44.486304 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-91c335f1-aada-44b7-9fcf-2331aa93ec99 req-708b559e-6ece-42cc-9be3-ab4fe4ec793e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283b33da-e8e6-410d-ad5f-c2cf46a745f3", "name": "network-vif-plugged", "status": "completed", "tag": "4c14653f-ef76-4b3c-9ecd-883ef3aced8d"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:44.491803 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cfc64c70-7030-492c-ba92-62ad708fab88 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1318 microversion: 2.1 time: 0.159074 Jun 07 13:27:44.492584 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 458/941] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:44 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:44.496047 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-91c335f1-aada-44b7-9fcf-2331aa93ec99 req-708b559e-6ece-42cc-9be3-ab4fe4ec793e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:44.496585 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-91c335f1-aada-44b7-9fcf-2331aa93ec99 req-708b559e-6ece-42cc-9be3-ab4fe4ec793e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:44.508350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-91c335f1-aada-44b7-9fcf-2331aa93ec99 req-708b559e-6ece-42cc-9be3-ab4fe4ec793e service nova] Creating event network-vif-plugged:4c14653f-ef76-4b3c-9ecd-883ef3aced8d for instance 283b33da-e8e6-410d-ad5f-c2cf46a745f3 on hv-cinder-84460 Jun 07 13:27:44.513219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-91c335f1-aada-44b7-9fcf-2331aa93ec99 req-708b559e-6ece-42cc-9be3-ab4fe4ec793e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031312 Jun 07 13:27:44.513805 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 484/942] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:27:45.508945 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e72a63fc-9da4-4d8e-afdb-7c8d6db628b9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:45.509560 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e72a63fc-9da4-4d8e-afdb-7c8d6db628b9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:45.516071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e72a63fc-9da4-4d8e-afdb-7c8d6db628b9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:45.516516 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e72a63fc-9da4-4d8e-afdb-7c8d6db628b9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:45.517497 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e72a63fc-9da4-4d8e-afdb-7c8d6db628b9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:45.518254 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e72a63fc-9da4-4d8e-afdb-7c8d6db628b9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:45.645183 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e72a63fc-9da4-4d8e-afdb-7c8d6db628b9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:45.652509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e72a63fc-9da4-4d8e-afdb-7c8d6db628b9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1318 microversion: 2.1 time: 0.147448 Jun 07 13:27:45.653066 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 459/943] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:45 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:46.465544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-114a682e-336f-49d7-9817-7ccca88d3f4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:46.466573 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-114a682e-336f-49d7-9817-7ccca88d3f4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:46.472718 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-114a682e-336f-49d7-9817-7ccca88d3f4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.473175 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-114a682e-336f-49d7-9817-7ccca88d3f4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.473943 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-114a682e-336f-49d7-9817-7ccca88d3f4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.474382 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-114a682e-336f-49d7-9817-7ccca88d3f4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.503306 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-114a682e-336f-49d7-9817-7ccca88d3f4e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042448 Jun 07 13:27:46.503852 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 485/944] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:27:46 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:27:46.563001 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c17fc496-1f69-4853-b3af-363430a1cfb1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:46.563506 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c17fc496-1f69-4853-b3af-363430a1cfb1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:46.569454 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c17fc496-1f69-4853-b3af-363430a1cfb1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.569897 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c17fc496-1f69-4853-b3af-363430a1cfb1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.570649 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c17fc496-1f69-4853-b3af-363430a1cfb1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.571106 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c17fc496-1f69-4853-b3af-363430a1cfb1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.596102 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c17fc496-1f69-4853-b3af-363430a1cfb1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Going to try to terminate instance {{(pid=117842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:27:46.670072 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c17fc496-1f69-4853-b3af-363430a1cfb1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 204 len: 0 microversion: 2.1 time: 0.111149 Jun 07 13:27:46.671232 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1277a6b9-f86b-4534-88b2-3a8735c12f28 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:46.671415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 460/945] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:27:46 2022] DELETE /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:27:46.671813 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1277a6b9-f86b-4534-88b2-3a8735c12f28 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:46.679638 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-abfe87aa-e7a3-4418-8b5b-a0faa02423c2 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:46.679925 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1277a6b9-f86b-4534-88b2-3a8735c12f28 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.680321 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-abfe87aa-e7a3-4418-8b5b-a0faa02423c2 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:46.680433 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1277a6b9-f86b-4534-88b2-3a8735c12f28 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.681149 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1277a6b9-f86b-4534-88b2-3a8735c12f28 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.681589 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1277a6b9-f86b-4534-88b2-3a8735c12f28 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.686244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abfe87aa-e7a3-4418-8b5b-a0faa02423c2 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.687380 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abfe87aa-e7a3-4418-8b5b-a0faa02423c2 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.688145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abfe87aa-e7a3-4418-8b5b-a0faa02423c2 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.688577 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-abfe87aa-e7a3-4418-8b5b-a0faa02423c2 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.881305 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1277a6b9-f86b-4534-88b2-3a8735c12f28 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:46.884490 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-abfe87aa-e7a3-4418-8b5b-a0faa02423c2 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:46.888925 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1277a6b9-f86b-4534-88b2-3a8735c12f28 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1507 microversion: 2.1 time: 0.222983 Jun 07 13:27:46.889498 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 486/946] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:46 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:27:46.892071 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-abfe87aa-e7a3-4418-8b5b-a0faa02423c2 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1670 microversion: 2.1 time: 0.216560 Jun 07 13:27:46.892636 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 461/947] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:46 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1670 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:27:46.904621 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8c8f5546-93dd-4879-8392-c792ea1cc12b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c212270-d65c-4d05-9044-2a2a85820de0", "device": "/dev/sdb"}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:46.906196 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8c8f5546-93dd-4879-8392-c792ea1cc12b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:46.912012 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c8f5546-93dd-4879-8392-c792ea1cc12b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.912444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c8f5546-93dd-4879-8392-c792ea1cc12b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.913198 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c8f5546-93dd-4879-8392-c792ea1cc12b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.913634 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8c8f5546-93dd-4879-8392-c792ea1cc12b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:47.908479 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-12dcc356-113d-4ebf-8685-ae15ea654868 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:47.909092 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-12dcc356-113d-4ebf-8685-ae15ea654868 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:47.915620 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-12dcc356-113d-4ebf-8685-ae15ea654868 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:47.916075 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-12dcc356-113d-4ebf-8685-ae15ea654868 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:47.916835 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-12dcc356-113d-4ebf-8685-ae15ea654868 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:47.917272 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-12dcc356-113d-4ebf-8685-ae15ea654868 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:48.048621 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-12dcc356-113d-4ebf-8685-ae15ea654868 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:48.056040 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-12dcc356-113d-4ebf-8685-ae15ea654868 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1670 microversion: 2.1 time: 0.151496 Jun 07 13:27:48.056642 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 462/948] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:47 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:27:48.576679 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:48.596520 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=6 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:48.643484 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8c8f5546-93dd-4879-8392-c792ea1cc12b tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "POST /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.742288 Jun 07 13:27:48.644101 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 487/949] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:27:46 2022] POST /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3/os-volume_attachments => generated 194 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:27:49.073732 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6ed6f357-6cd6-4ccd-8f5c-84bd837de49c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:49.074349 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6ed6f357-6cd6-4ccd-8f5c-84bd837de49c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:49.076429 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:49.083506 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6ed6f357-6cd6-4ccd-8f5c-84bd837de49c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:49.083973 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6ed6f357-6cd6-4ccd-8f5c-84bd837de49c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:49.084754 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6ed6f357-6cd6-4ccd-8f5c-84bd837de49c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:49.085208 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6ed6f357-6cd6-4ccd-8f5c-84bd837de49c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:49.224167 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-6ed6f357-6cd6-4ccd-8f5c-84bd837de49c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:49.232024 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6ed6f357-6cd6-4ccd-8f5c-84bd837de49c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1670 microversion: 2.1 time: 0.162239 Jun 07 13:27:49.232594 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 463/950] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:49 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:49.798162 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-be92fe2a-4925-4109-a01d-878f0e4aa5d2 req-42e702a8-a25d-48f0-b6e7-fc11ca3f1e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5264ef-a5c4-498e-8c65-af627dcfa757", "name": "network-vif-deleted", "tag": "1d4702b2-63b5-41cf-b9f0-f021d1576e6f"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:49.809266 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-be92fe2a-4925-4109-a01d-878f0e4aa5d2 req-42e702a8-a25d-48f0-b6e7-fc11ca3f1e36 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:49.809722 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-be92fe2a-4925-4109-a01d-878f0e4aa5d2 req-42e702a8-a25d-48f0-b6e7-fc11ca3f1e36 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:49.822505 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-be92fe2a-4925-4109-a01d-878f0e4aa5d2 req-42e702a8-a25d-48f0-b6e7-fc11ca3f1e36 service nova] Creating event network-vif-deleted:1d4702b2-63b5-41cf-b9f0-f021d1576e6f for instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 on hv-cinder-84460 Jun 07 13:27:49.828821 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-be92fe2a-4925-4109-a01d-878f0e4aa5d2 req-42e702a8-a25d-48f0-b6e7-fc11ca3f1e36 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036170 Jun 07 13:27:49.829587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 488/951] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:27:50.249920 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:50.250519 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:50.264116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:50.265424 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:50.266500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:50.266970 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:50.300569 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:50.301028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:50.301484 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lazy-loading 'fault' on Instance uuid 1a5264ef-a5c4-498e-8c65-af627dcfa757 {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:27:50.348811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:50.355569 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-524ce190-21c4-4a70-add3-e0feb6add9de tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 200 len: 1326 microversion: 2.1 time: 0.110049 Jun 07 13:27:50.356145 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 464/952] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:50 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:51.374001 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:51.374701 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:51.381350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:51.381799 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:51.382678 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:51.383146 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:51.396392 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] HTTP exception thrown: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Request method failure captured: Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 HTTP/1.1 Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1Fjh8u2Zu9e5lPBeW96COVODxPg-ICO1tj1it2_DjvUmWi84fixCBWpBiBX0Ndqf4YJMw2PBa8ImU62YHuWNhupua0HIg0tpX5091eB9evuFZ6F3490bFNV1wt0LcG9PKIh6M4j23VnKLARt57apmMzbKTWWUykdJ9SgSJd0AWC1Hk Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:27:51.397969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: a5766b86063f4955a642ae59e28ee226 Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:27:51.399682 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '1a5264ef-a5c4-498e-8c65-af627dcfa757'} Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:27:51.400546 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:27:51.402105 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:27:51.403499 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Returning 404 to user: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:27:51.403499 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-173ec078-8cc9-41f0-8795-c39adf6bbab8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 404 len: 111 microversion: 2.1 time: 0.029633 Jun 07 13:27:51.403499 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 489/953] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:51 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:27:51.408894 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d91a71c1-0460-4b2d-8184-574307f485f8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '.version_select at 0x7f46a36d0e50>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:51.426464 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d91a71c1-0460-4b2d-8184-574307f485f8 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255008121" status: 202 len: 0 microversion: 2.1 time: 0.022008 Jun 07 13:27:51.427087 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 465/954] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Jun 7 13:27:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255008121 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:27:52.028886 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-98566a47-71f7-4302-9977-6be263c990ca tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'create', calling method: .version_select at 0x7f46a35c80d0>, body: {"keypair": {"name": "tempest-keypair-259546808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApaUrnj0Il3Z5ygMI7c3xDLNMh+98DWp/1La2XUdJBniqmLwSCLFoQeKIaE08QyqjsAMDjYbT3tXDNtKcKLrRGj/tm9F00tjZzquRgGhMqm/DCU/Zr8kQtMpv1k83Wphg=="}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:52.043768 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-98566a47-71f7-4302-9977-6be263c990ca tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Getting quotas for project 5541835571f64b4dbec6cabbbd6b13ca. Resources: {'key_pairs'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:27:52.048058 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-98566a47-71f7-4302-9977-6be263c990ca tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Getting quotas for user a5766b86063f4955a642ae59e28ee226 and project 5541835571f64b4dbec6cabbbd6b13ca. Resources: {'key_pairs'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:27:52.069793 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-98566a47-71f7-4302-9977-6be263c990ca tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044808 Jun 07 13:27:52.070401 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 490/955] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:27:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:27:52.257546 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-96210c3c-f23a-4c90-9396-2ecfbd141d10 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:52.258492 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-96210c3c-f23a-4c90-9396-2ecfbd141d10 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:52.265012 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96210c3c-f23a-4c90-9396-2ecfbd141d10 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:52.265460 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96210c3c-f23a-4c90-9396-2ecfbd141d10 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:52.266218 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96210c3c-f23a-4c90-9396-2ecfbd141d10 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:52.266652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-96210c3c-f23a-4c90-9396-2ecfbd141d10 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:52.348711 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-96210c3c-f23a-4c90-9396-2ecfbd141d10 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "POST /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/action" status: 202 len: 0 microversion: 2.1 time: 0.094828 Jun 07 13:27:52.349581 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 466/956] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:27:52 2022] POST /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:27:52.360284 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0da2ea33-979e-4bc8-8471-cbf56148982c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:52.361408 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0da2ea33-979e-4bc8-8471-cbf56148982c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:52.369808 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0da2ea33-979e-4bc8-8471-cbf56148982c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:52.370748 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0da2ea33-979e-4bc8-8471-cbf56148982c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:52.372300 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0da2ea33-979e-4bc8-8471-cbf56148982c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:52.372843 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0da2ea33-979e-4bc8-8471-cbf56148982c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:52.585954 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0da2ea33-979e-4bc8-8471-cbf56148982c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:52.595650 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0da2ea33-979e-4bc8-8471-cbf56148982c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1752 microversion: 2.1 time: 0.241066 Jun 07 13:27:52.596505 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 491/957] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:52 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1752 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:53.470103 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-536338138", "imageRef": "ead67c43-2976-497b-a41f-62e79a60e5fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d03f50ab-3c90-41eb-b646-98d9eb95947d"}], "security_groups": [{"name": "tempest-securitygroup--246657819"}], "key_name": "tempest-keypair-259546808", "user_data": "}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:53.569800 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.network.neutron [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] validate_networks() for [('d03f50ab-3c90-41eb-b646-98d9eb95947d', None, None, None, None, None)] {{(pid=117842) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:27:53.614069 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-755665dc-50dc-48c5-9192-5aa163e84262 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:53.614692 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-755665dc-50dc-48c5-9192-5aa163e84262 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:53.621169 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-755665dc-50dc-48c5-9192-5aa163e84262 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:53.621625 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-755665dc-50dc-48c5-9192-5aa163e84262 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:53.622425 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-755665dc-50dc-48c5-9192-5aa163e84262 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:53.622888 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-755665dc-50dc-48c5-9192-5aa163e84262 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:53.821023 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-755665dc-50dc-48c5-9192-5aa163e84262 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:53.829184 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-755665dc-50dc-48c5-9192-5aa163e84262 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.219229 Jun 07 13:27:53.830106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 492/958] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:53 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:27:54.221692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Flavor limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:27:54.222122 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Image limits 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:27:54.222596 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Flavor pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:27:54.223041 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Image pref 0:0:0 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:27:54.223456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.virt.hardware [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:27:54.232252 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:54.232703 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:54.233500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:54.233939 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:54.253241 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Getting quotas for project 5541835571f64b4dbec6cabbbd6b13ca. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:27:54.257265 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Getting quotas for user a5766b86063f4955a642ae59e28ee226 and project 5541835571f64b4dbec6cabbbd6b13ca. Resources: {'cores', 'instances', 'ram'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:27:54.273991 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Going to run 1 instances... {{(pid=117842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:27:54.276385 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ead67c43-2976-497b-a41f-62e79a60e5fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:27:54.332832 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-cbf60da8-2245-4a8e-9eba-06320da06765 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.867743 Jun 07 13:27:54.338287 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 467/959] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:27:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:27:54.343768 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-96564c7d-453a-4b65-8a8a-2954cce99a3b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:54.344386 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-96564c7d-453a-4b65-8a8a-2954cce99a3b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:54.409762 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-96564c7d-453a-4b65-8a8a-2954cce99a3b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:54.416693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-96564c7d-453a-4b65-8a8a-2954cce99a3b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1236 microversion: 2.1 time: 0.077281 Jun 07 13:27:54.417259 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 493/960] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:54 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1236 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:54.847527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a2cfa634-1091-43ee-ae73-8586d299217c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:54.848179 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a2cfa634-1091-43ee-ae73-8586d299217c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:54.855429 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a2cfa634-1091-43ee-ae73-8586d299217c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:54.855881 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a2cfa634-1091-43ee-ae73-8586d299217c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:54.856654 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a2cfa634-1091-43ee-ae73-8586d299217c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:54.857094 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a2cfa634-1091-43ee-ae73-8586d299217c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:54.999161 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a2cfa634-1091-43ee-ae73-8586d299217c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:55.007235 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a2cfa634-1091-43ee-ae73-8586d299217c tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.164362 Jun 07 13:27:55.007805 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 468/961] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:54 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:55.434303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-72d0bdc5-beaf-4aef-93b3-13f545602018 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:55.434952 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-72d0bdc5-beaf-4aef-93b3-13f545602018 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:55.442619 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72d0bdc5-beaf-4aef-93b3-13f545602018 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:55.443096 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72d0bdc5-beaf-4aef-93b3-13f545602018 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:55.443865 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72d0bdc5-beaf-4aef-93b3-13f545602018 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:55.444301 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-72d0bdc5-beaf-4aef-93b3-13f545602018 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:55.508845 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-72d0bdc5-beaf-4aef-93b3-13f545602018 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:55.516318 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-72d0bdc5-beaf-4aef-93b3-13f545602018 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1288 microversion: 2.1 time: 0.086586 Jun 07 13:27:55.516882 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 494/962] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:55 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:56.024364 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-bf62c57f-c978-485e-b67a-1e1ff119f6db tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:56.024982 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-bf62c57f-c978-485e-b67a-1e1ff119f6db tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:56.032005 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bf62c57f-c978-485e-b67a-1e1ff119f6db tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:56.032005 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bf62c57f-c978-485e-b67a-1e1ff119f6db tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:56.032623 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bf62c57f-c978-485e-b67a-1e1ff119f6db tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:56.033057 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bf62c57f-c978-485e-b67a-1e1ff119f6db tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:56.198256 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-bf62c57f-c978-485e-b67a-1e1ff119f6db tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:56.206680 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-bf62c57f-c978-485e-b67a-1e1ff119f6db tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.186118 Jun 07 13:27:56.207291 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 469/963] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:56 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:56.533834 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-180bc234-1345-45a8-9c50-8940a8f0b926 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:56.534495 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-180bc234-1345-45a8-9c50-8940a8f0b926 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:56.541518 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-180bc234-1345-45a8-9c50-8940a8f0b926 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:56.541978 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-180bc234-1345-45a8-9c50-8940a8f0b926 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:56.542770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-180bc234-1345-45a8-9c50-8940a8f0b926 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:56.543235 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-180bc234-1345-45a8-9c50-8940a8f0b926 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:56.674988 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-180bc234-1345-45a8-9c50-8940a8f0b926 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:56.682429 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-180bc234-1345-45a8-9c50-8940a8f0b926 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.152847 Jun 07 13:27:56.683023 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 495/964] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:56 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:57.224348 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1e480acb-a283-4fe4-9b9b-b03c93b8cc11 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:57.233168 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-787c32cb-4464-4604-b47a-97c7b14845a3 req-7ad5cd7a-1b53-4ef0-8a5c-2490c6bb692b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24d9423-098a-4175-8de5-832b703e7bf5", "tag": "985ab1c0-0915-4d8d-ae21-d4b38500b6a3"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:57.240640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1e480acb-a283-4fe4-9b9b-b03c93b8cc11 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:57.241791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-787c32cb-4464-4604-b47a-97c7b14845a3 req-7ad5cd7a-1b53-4ef0-8a5c-2490c6bb692b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:57.244923 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-787c32cb-4464-4604-b47a-97c7b14845a3 req-7ad5cd7a-1b53-4ef0-8a5c-2490c6bb692b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:57.247806 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1e480acb-a283-4fe4-9b9b-b03c93b8cc11 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:57.248274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1e480acb-a283-4fe4-9b9b-b03c93b8cc11 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:57.249053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1e480acb-a283-4fe4-9b9b-b03c93b8cc11 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:57.249714 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1e480acb-a283-4fe4-9b9b-b03c93b8cc11 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:57.258364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-787c32cb-4464-4604-b47a-97c7b14845a3 req-7ad5cd7a-1b53-4ef0-8a5c-2490c6bb692b service nova] Creating event network-changed:985ab1c0-0915-4d8d-ae21-d4b38500b6a3 for instance f24d9423-098a-4175-8de5-832b703e7bf5 on hv-cinder-84460 Jun 07 13:27:57.267819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-787c32cb-4464-4604-b47a-97c7b14845a3 req-7ad5cd7a-1b53-4ef0-8a5c-2490c6bb692b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038404 Jun 07 13:27:57.268434 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 496/965] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:27:57.407357 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1e480acb-a283-4fe4-9b9b-b03c93b8cc11 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:57.415413 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1e480acb-a283-4fe4-9b9b-b03c93b8cc11 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.194935 Jun 07 13:27:57.420309 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 470/966] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:57 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:57.700915 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-41ece77d-0bd7-4b92-a271-89c76e5c53c3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:57.702272 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-41ece77d-0bd7-4b92-a271-89c76e5c53c3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:57.708455 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-41ece77d-0bd7-4b92-a271-89c76e5c53c3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:57.708903 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-41ece77d-0bd7-4b92-a271-89c76e5c53c3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:57.709659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-41ece77d-0bd7-4b92-a271-89c76e5c53c3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:57.710092 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-41ece77d-0bd7-4b92-a271-89c76e5c53c3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:57.835048 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-41ece77d-0bd7-4b92-a271-89c76e5c53c3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:57.842396 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-41ece77d-0bd7-4b92-a271-89c76e5c53c3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.146168 Jun 07 13:27:57.842979 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 497/967] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:57 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:27:58.432542 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-10a4a544-eaf9-4676-a627-8409fe1dcf82 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:58.433184 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-10a4a544-eaf9-4676-a627-8409fe1dcf82 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:58.439819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10a4a544-eaf9-4676-a627-8409fe1dcf82 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:58.440267 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10a4a544-eaf9-4676-a627-8409fe1dcf82 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:58.441021 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10a4a544-eaf9-4676-a627-8409fe1dcf82 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:58.441453 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-10a4a544-eaf9-4676-a627-8409fe1dcf82 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:58.581444 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-10a4a544-eaf9-4676-a627-8409fe1dcf82 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:58.585065 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:58.590344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-10a4a544-eaf9-4676-a627-8409fe1dcf82 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.161730 Jun 07 13:27:58.591131 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 471/968] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:58 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:58.858704 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-05895d64-7518-4417-9664-2108d65aa151 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:58.859281 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-05895d64-7518-4417-9664-2108d65aa151 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:58.866273 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-05895d64-7518-4417-9664-2108d65aa151 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:58.866730 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-05895d64-7518-4417-9664-2108d65aa151 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:58.867534 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-05895d64-7518-4417-9664-2108d65aa151 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:58.867979 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-05895d64-7518-4417-9664-2108d65aa151 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:58.992090 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-05895d64-7518-4417-9664-2108d65aa151 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:58.999509 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-05895d64-7518-4417-9664-2108d65aa151 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.144785 Jun 07 13:27:59.000081 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 498/969] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:58 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:59.608589 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fdb308b4-2063-4ff8-b73e-44c9052d0a88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:59.609116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fdb308b4-2063-4ff8-b73e-44c9052d0a88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:59.616762 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fdb308b4-2063-4ff8-b73e-44c9052d0a88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:59.617217 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fdb308b4-2063-4ff8-b73e-44c9052d0a88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:59.617977 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fdb308b4-2063-4ff8-b73e-44c9052d0a88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:59.618408 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fdb308b4-2063-4ff8-b73e-44c9052d0a88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:59.872193 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fdb308b4-2063-4ff8-b73e-44c9052d0a88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:59.880700 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fdb308b4-2063-4ff8-b73e-44c9052d0a88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.276063 Jun 07 13:27:59.881269 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 472/970] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:59 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:00.016932 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ce76d10a-b4b9-417a-9194-db9043da5e60 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:00.017648 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ce76d10a-b4b9-417a-9194-db9043da5e60 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:00.024182 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ce76d10a-b4b9-417a-9194-db9043da5e60 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:00.024632 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ce76d10a-b4b9-417a-9194-db9043da5e60 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:00.025395 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ce76d10a-b4b9-417a-9194-db9043da5e60 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:00.025831 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ce76d10a-b4b9-417a-9194-db9043da5e60 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:00.157259 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ce76d10a-b4b9-417a-9194-db9043da5e60 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:00.164549 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ce76d10a-b4b9-417a-9194-db9043da5e60 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.152191 Jun 07 13:28:00.165110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 499/971] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:00 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:00.898774 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0bf489ab-d637-4b7d-b9a5-feb89419e319 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:00.899409 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0bf489ab-d637-4b7d-b9a5-feb89419e319 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:00.906585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0bf489ab-d637-4b7d-b9a5-feb89419e319 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:00.907068 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0bf489ab-d637-4b7d-b9a5-feb89419e319 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:00.907833 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0bf489ab-d637-4b7d-b9a5-feb89419e319 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:00.908271 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0bf489ab-d637-4b7d-b9a5-feb89419e319 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:01.102244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0bf489ab-d637-4b7d-b9a5-feb89419e319 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:01.111699 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0bf489ab-d637-4b7d-b9a5-feb89419e319 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.216496 Jun 07 13:28:01.112276 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 473/972] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:00 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:01.184452 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5404ab16-e449-4bba-9803-1bbc88a8f09f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:01.185065 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5404ab16-e449-4bba-9803-1bbc88a8f09f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:01.192310 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5404ab16-e449-4bba-9803-1bbc88a8f09f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:01.192759 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5404ab16-e449-4bba-9803-1bbc88a8f09f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:01.193523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5404ab16-e449-4bba-9803-1bbc88a8f09f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:01.193958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5404ab16-e449-4bba-9803-1bbc88a8f09f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:01.211664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:01.414577 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-5404ab16-e449-4bba-9803-1bbc88a8f09f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:01.422965 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5404ab16-e449-4bba-9803-1bbc88a8f09f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.242294 Jun 07 13:28:01.423542 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 500/973] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:01 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:01.937496 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8d9a1d59-80f6-457d-af91-8238900c57a7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:01.938201 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8d9a1d59-80f6-457d-af91-8238900c57a7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:01.939587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-a92b3944-8e24-4d23-9517-8c24804b07fb req-09a222ad-501c-4748-9e17-67210489caa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50eb4fa0-5e14-46c7-89db-b095754d73ea", "tag": "b83954e8-7ec5-4676-8eb6-33daf88474b1"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:01.945008 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d9a1d59-80f6-457d-af91-8238900c57a7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:01.945756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d9a1d59-80f6-457d-af91-8238900c57a7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:01.946762 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d9a1d59-80f6-457d-af91-8238900c57a7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:01.947311 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8d9a1d59-80f6-457d-af91-8238900c57a7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:01.947577 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-a92b3944-8e24-4d23-9517-8c24804b07fb req-09a222ad-501c-4748-9e17-67210489caa0 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:01.948024 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-a92b3944-8e24-4d23-9517-8c24804b07fb req-09a222ad-501c-4748-9e17-67210489caa0 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:01.961632 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-a92b3944-8e24-4d23-9517-8c24804b07fb req-09a222ad-501c-4748-9e17-67210489caa0 service nova] Creating event network-changed:b83954e8-7ec5-4676-8eb6-33daf88474b1 for instance 50eb4fa0-5e14-46c7-89db-b095754d73ea on hv-cinder-84460 Jun 07 13:28:01.966903 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-a92b3944-8e24-4d23-9517-8c24804b07fb req-09a222ad-501c-4748-9e17-67210489caa0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030773 Jun 07 13:28:01.968169 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 501/974] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:28:01.974749 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8d9a1d59-80f6-457d-af91-8238900c57a7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Going to try to terminate instance {{(pid=117842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:28:02.050551 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8d9a1d59-80f6-457d-af91-8238900c57a7 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "DELETE /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 204 len: 0 microversion: 2.1 time: 0.116983 Jun 07 13:28:02.051471 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 474/975] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:01 2022] DELETE /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:28:02.060050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-73126b4d-ac2f-4100-8a7e-ab7f7f75b184 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:02.061236 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-73126b4d-ac2f-4100-8a7e-ab7f7f75b184 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:02.067450 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-73126b4d-ac2f-4100-8a7e-ab7f7f75b184 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:02.067899 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-73126b4d-ac2f-4100-8a7e-ab7f7f75b184 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:02.068660 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-73126b4d-ac2f-4100-8a7e-ab7f7f75b184 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:02.069096 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-73126b4d-ac2f-4100-8a7e-ab7f7f75b184 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:02.130422 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ae819fae-499d-4701-b736-f4bc023d0a61 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:02.131235 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ae819fae-499d-4701-b736-f4bc023d0a61 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:02.138366 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae819fae-499d-4701-b736-f4bc023d0a61 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:02.139429 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae819fae-499d-4701-b736-f4bc023d0a61 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:02.140214 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae819fae-499d-4701-b736-f4bc023d0a61 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:02.140658 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae819fae-499d-4701-b736-f4bc023d0a61 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:02.327145 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-73126b4d-ac2f-4100-8a7e-ab7f7f75b184 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:02.335089 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-73126b4d-ac2f-4100-8a7e-ab7f7f75b184 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1578 microversion: 2.1 time: 0.279115 Jun 07 13:28:02.335906 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 502/976] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:02 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1578 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:02.341797 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ae819fae-499d-4701-b736-f4bc023d0a61 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:02.350004 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ae819fae-499d-4701-b736-f4bc023d0a61 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.224205 Jun 07 13:28:02.350652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 475/977] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:02 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:02.439974 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3c8eeb19-ac57-4712-b4c9-62c6c32f7c82 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:02.440586 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3c8eeb19-ac57-4712-b4c9-62c6c32f7c82 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:02.446555 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c8eeb19-ac57-4712-b4c9-62c6c32f7c82 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:02.447039 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c8eeb19-ac57-4712-b4c9-62c6c32f7c82 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:02.447802 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c8eeb19-ac57-4712-b4c9-62c6c32f7c82 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:02.448612 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3c8eeb19-ac57-4712-b4c9-62c6c32f7c82 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:02.579185 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3c8eeb19-ac57-4712-b4c9-62c6c32f7c82 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:02.586784 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3c8eeb19-ac57-4712-b4c9-62c6c32f7c82 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.151215 Jun 07 13:28:02.587381 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 503/978] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:02 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:03.353028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c7e6b1d8-23c8-4d43-be63-c5d3f64d8371 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:03.353647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c7e6b1d8-23c8-4d43-be63-c5d3f64d8371 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:03.360543 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c7e6b1d8-23c8-4d43-be63-c5d3f64d8371 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:03.361002 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c7e6b1d8-23c8-4d43-be63-c5d3f64d8371 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:03.361769 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c7e6b1d8-23c8-4d43-be63-c5d3f64d8371 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:03.362215 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c7e6b1d8-23c8-4d43-be63-c5d3f64d8371 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:03.367206 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2ea4444f-e224-49c2-9e66-10c1ce6da4a4 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:03.367826 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2ea4444f-e224-49c2-9e66-10c1ce6da4a4 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:03.374151 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2ea4444f-e224-49c2-9e66-10c1ce6da4a4 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:03.374607 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2ea4444f-e224-49c2-9e66-10c1ce6da4a4 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:03.375409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2ea4444f-e224-49c2-9e66-10c1ce6da4a4 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:03.375855 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2ea4444f-e224-49c2-9e66-10c1ce6da4a4 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:03.562621 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c7e6b1d8-23c8-4d43-be63-c5d3f64d8371 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:03.570647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c7e6b1d8-23c8-4d43-be63-c5d3f64d8371 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1578 microversion: 2.1 time: 0.221475 Jun 07 13:28:03.571250 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 476/979] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:03 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:03.582093 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2ea4444f-e224-49c2-9e66-10c1ce6da4a4 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:03.590081 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2ea4444f-e224-49c2-9e66-10c1ce6da4a4 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.226669 Jun 07 13:28:03.590652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 504/980] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:03 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:03.603988 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c9b492f1-fc46-425d-8d91-aee98b7b2610 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:03.604560 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c9b492f1-fc46-425d-8d91-aee98b7b2610 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:03.610796 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9b492f1-fc46-425d-8d91-aee98b7b2610 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:03.611279 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9b492f1-fc46-425d-8d91-aee98b7b2610 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:03.612050 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9b492f1-fc46-425d-8d91-aee98b7b2610 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:03.612492 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9b492f1-fc46-425d-8d91-aee98b7b2610 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:03.743420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c9b492f1-fc46-425d-8d91-aee98b7b2610 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:03.752617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c9b492f1-fc46-425d-8d91-aee98b7b2610 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.152603 Jun 07 13:28:03.753202 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 477/981] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:03 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:04.588684 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-9642a1a0-c755-48e0-8e14-59c2656e7988 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:04.589329 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-9642a1a0-c755-48e0-8e14-59c2656e7988 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:04.591785 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=6 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:04.597450 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9642a1a0-c755-48e0-8e14-59c2656e7988 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:04.597933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9642a1a0-c755-48e0-8e14-59c2656e7988 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:04.598697 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9642a1a0-c755-48e0-8e14-59c2656e7988 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:04.599159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-9642a1a0-c755-48e0-8e14-59c2656e7988 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:04.607194 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-bd88c124-1773-4b2b-b63c-e460ef480982 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:04.607809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-bd88c124-1773-4b2b-b63c-e460ef480982 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:04.609776 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:04.610693 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=6 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:04.617366 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bd88c124-1773-4b2b-b63c-e460ef480982 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:04.617774 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bd88c124-1773-4b2b-b63c-e460ef480982 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:04.618522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bd88c124-1773-4b2b-b63c-e460ef480982 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:04.619195 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bd88c124-1773-4b2b-b63c-e460ef480982 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:04.797090 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-9642a1a0-c755-48e0-8e14-59c2656e7988 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:04.804616 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-9642a1a0-c755-48e0-8e14-59c2656e7988 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1578 microversion: 2.1 time: 0.219814 Jun 07 13:28:04.805278 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 505/982] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:04 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:04.809796 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-96bdd357-d11f-4d67-a84d-b37951a2635c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:04.811203 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-96bdd357-d11f-4d67-a84d-b37951a2635c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:04.817059 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96bdd357-d11f-4d67-a84d-b37951a2635c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:04.817587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96bdd357-d11f-4d67-a84d-b37951a2635c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:04.818416 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96bdd357-d11f-4d67-a84d-b37951a2635c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:04.818951 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-96bdd357-d11f-4d67-a84d-b37951a2635c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:04.821645 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-bd88c124-1773-4b2b-b63c-e460ef480982 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:04.829677 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-bd88c124-1773-4b2b-b63c-e460ef480982 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.226324 Jun 07 13:28:04.830244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 478/983] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:04 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:04.957933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-96bdd357-d11f-4d67-a84d-b37951a2635c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:04.965634 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-96bdd357-d11f-4d67-a84d-b37951a2635c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.159359 Jun 07 13:28:04.966203 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 506/984] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:04 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:05.635766 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-ccb70119-ce04-4ea0-901b-243d250ea565 req-de721d4e-46ad-4dfb-bb9e-cd517eb83895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f24d9423-098a-4175-8de5-832b703e7bf5", "name": "network-vif-plugged", "status": "completed", "tag": "985ab1c0-0915-4d8d-ae21-d4b38500b6a3"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:05.647090 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-ccb70119-ce04-4ea0-901b-243d250ea565 req-de721d4e-46ad-4dfb-bb9e-cd517eb83895 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:05.647538 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-ccb70119-ce04-4ea0-901b-243d250ea565 req-de721d4e-46ad-4dfb-bb9e-cd517eb83895 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:05.662297 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-ccb70119-ce04-4ea0-901b-243d250ea565 req-de721d4e-46ad-4dfb-bb9e-cd517eb83895 service nova] Creating event network-vif-plugged:985ab1c0-0915-4d8d-ae21-d4b38500b6a3 for instance f24d9423-098a-4175-8de5-832b703e7bf5 on hv-cinder-84460 Jun 07 13:28:05.667784 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-ccb70119-ce04-4ea0-901b-243d250ea565 req-de721d4e-46ad-4dfb-bb9e-cd517eb83895 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036842 Jun 07 13:28:05.668838 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 479/985] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:28:05.823659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-d140ed3f-aabb-4dbd-9946-9402701405ba tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:05.824280 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-d140ed3f-aabb-4dbd-9946-9402701405ba tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:05.831905 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d140ed3f-aabb-4dbd-9946-9402701405ba tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:05.832464 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d140ed3f-aabb-4dbd-9946-9402701405ba tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:05.833304 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d140ed3f-aabb-4dbd-9946-9402701405ba tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:05.833814 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-d140ed3f-aabb-4dbd-9946-9402701405ba tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:05.850512 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-999b0d9c-b214-4a1a-8cae-85142f8713a8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:05.851456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-999b0d9c-b214-4a1a-8cae-85142f8713a8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:05.859692 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-999b0d9c-b214-4a1a-8cae-85142f8713a8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:05.867679 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-999b0d9c-b214-4a1a-8cae-85142f8713a8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:05.868728 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-999b0d9c-b214-4a1a-8cae-85142f8713a8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:05.869178 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-999b0d9c-b214-4a1a-8cae-85142f8713a8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:06.073298 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-d140ed3f-aabb-4dbd-9946-9402701405ba tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:06.086743 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-999b0d9c-b214-4a1a-8cae-85142f8713a8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:06.087176 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-d140ed3f-aabb-4dbd-9946-9402701405ba tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1578 microversion: 2.1 time: 0.264057 Jun 07 13:28:06.096017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 507/986] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:05 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1578 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:06.096017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8d5cc36f-fe65-4006-af57-46d00bf03a03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:06.096017 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8d5cc36f-fe65-4006-af57-46d00bf03a03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:06.096422 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-999b0d9c-b214-4a1a-8cae-85142f8713a8 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.252316 Jun 07 13:28:06.096422 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 480/987] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:05 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:06.099865 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8d5cc36f-fe65-4006-af57-46d00bf03a03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:06.100323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8d5cc36f-fe65-4006-af57-46d00bf03a03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:06.101087 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8d5cc36f-fe65-4006-af57-46d00bf03a03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:06.101538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8d5cc36f-fe65-4006-af57-46d00bf03a03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:06.231470 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-8d5cc36f-fe65-4006-af57-46d00bf03a03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:06.240701 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8d5cc36f-fe65-4006-af57-46d00bf03a03 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.151796 Jun 07 13:28:06.241285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 508/988] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:06 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:06.277249 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-f23c24c1-b9ce-4881-8dc7-7fe0c9ea914a req-240e0e17-0f87-48e3-a23e-89af0efe1453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50eb4fa0-5e14-46c7-89db-b095754d73ea", "name": "network-vif-deleted", "tag": "b83954e8-7ec5-4676-8eb6-33daf88474b1"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:06.285235 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-f23c24c1-b9ce-4881-8dc7-7fe0c9ea914a req-240e0e17-0f87-48e3-a23e-89af0efe1453 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:06.285758 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-f23c24c1-b9ce-4881-8dc7-7fe0c9ea914a req-240e0e17-0f87-48e3-a23e-89af0efe1453 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:06.297207 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-f23c24c1-b9ce-4881-8dc7-7fe0c9ea914a req-240e0e17-0f87-48e3-a23e-89af0efe1453 service nova] Creating event network-vif-deleted:b83954e8-7ec5-4676-8eb6-33daf88474b1 for instance 50eb4fa0-5e14-46c7-89db-b095754d73ea on hv-cinder-84460 Jun 07 13:28:06.301923 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-f23c24c1-b9ce-4881-8dc7-7fe0c9ea914a req-240e0e17-0f87-48e3-a23e-89af0efe1453 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028359 Jun 07 13:28:06.302515 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 481/989] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:07.105079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:07.105809 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:07.113474 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:07.113916 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:07.114816 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:07.115285 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:07.116704 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c67810c4-cda9-4c69-a706-e103655e28be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:07.118284 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c67810c4-cda9-4c69-a706-e103655e28be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:07.125238 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c67810c4-cda9-4c69-a706-e103655e28be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:07.125724 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c67810c4-cda9-4c69-a706-e103655e28be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:07.126517 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c67810c4-cda9-4c69-a706-e103655e28be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:07.126991 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c67810c4-cda9-4c69-a706-e103655e28be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:07.147130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:07.147506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:07.147958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lazy-loading 'fault' on Instance uuid 50eb4fa0-5e14-46c7-89db-b095754d73ea {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:28:07.217327 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:07.224816 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-77948835-ec66-4d7b-967c-2f22b6a36e8c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 200 len: 1231 microversion: 2.1 time: 0.123841 Jun 07 13:28:07.225387 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 509/990] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:07 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 1231 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:07.257537 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-dddabc81-870d-4c51-9264-ac079c463b87 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:07.258159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-dddabc81-870d-4c51-9264-ac079c463b87 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:07.264668 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dddabc81-870d-4c51-9264-ac079c463b87 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:07.265157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dddabc81-870d-4c51-9264-ac079c463b87 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:07.265929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dddabc81-870d-4c51-9264-ac079c463b87 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:07.266373 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dddabc81-870d-4c51-9264-ac079c463b87 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:07.297386 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c67810c4-cda9-4c69-a706-e103655e28be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:07.305682 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c67810c4-cda9-4c69-a706-e103655e28be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.194734 Jun 07 13:28:07.306358 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 482/991] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:07 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:07.395047 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-dddabc81-870d-4c51-9264-ac079c463b87 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:07.402738 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-dddabc81-870d-4c51-9264-ac079c463b87 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1361 microversion: 2.1 time: 0.149212 Jun 07 13:28:07.403269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 510/992] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:07 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:08.026821 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9f3fa76e-34cd-43aa-a950-64668aa9b5f3 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:08.027616 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9f3fa76e-34cd-43aa-a950-64668aa9b5f3 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:08.034284 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9f3fa76e-34cd-43aa-a950-64668aa9b5f3 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.034751 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9f3fa76e-34cd-43aa-a950-64668aa9b5f3 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.035547 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9f3fa76e-34cd-43aa-a950-64668aa9b5f3 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.036001 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9f3fa76e-34cd-43aa-a950-64668aa9b5f3 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.115957 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-9f3fa76e-34cd-43aa-a950-64668aa9b5f3 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lazy-loading 'services' on Instance uuid 283b33da-e8e6-410d-ad5f-c2cf46a745f3 {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:28:08.185080 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9f3fa76e-34cd-43aa-a950-64668aa9b5f3 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "DELETE /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3/os-volume_attachments/2c212270-d65c-4d05-9044-2a2a85820de0" status: 202 len: 0 microversion: 2.1 time: 0.162099 Jun 07 13:28:08.185741 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 483/993] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:28:08 2022] DELETE /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3/os-volume_attachments/2c212270-d65c-4d05-9044-2a2a85820de0 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:28:08.241649 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:08.242534 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 50eb4fa0-5e14-46c7-89db-b095754d73ea] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:08.244913 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:08.250711 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.251256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.252186 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.252690 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.266960 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] HTTP exception thrown: Instance 50eb4fa0-5e14-46c7-89db-b095754d73ea could not be found. Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Request method failure captured: Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea HTTP/1.1 Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1Ca-DPRahE7U6wJfA_TS-oddu6O-I73txX2u1Z2sWh9wI856WP-g2rdzQTuyTYDTEsKT86KtHt5mFZC7ZjmG2A6p5iFaovEpl4sbNcAMXBD2X5lL7oKsxMeskoazifQIHdqq8xL_51ABA9Y5ktloFNZdQUMH_u7l3HLHnidXlTm38k Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:28:08.268724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 36c5458a18f146be87207e0f6dd598eb Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 50eb4fa0-5e14-46c7-89db-b095754d73ea could not be found. Jun 07 13:28:08.270418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '50eb4fa0-5e14-46c7-89db-b095754d73ea'} Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50eb4fa0-5e14-46c7-89db-b095754d73ea could not be found. Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:08.271385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50eb4fa0-5e14-46c7-89db-b095754d73ea could not be found. Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50eb4fa0-5e14-46c7-89db-b095754d73ea could not be found. Jun 07 13:28:08.272846 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:08.274274 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Returning 404 to user: Instance 50eb4fa0-5e14-46c7-89db-b095754d73ea could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:08.274274 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-788600c6-395e-4ecf-a7f0-2cc24788f0cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea" status: 404 len: 111 microversion: 2.1 time: 0.033351 Jun 07 13:28:08.276245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 511/994] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:08 2022] GET /compute/v2.1/servers/50eb4fa0-5e14-46c7-89db-b095754d73ea => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:08.324166 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ed39d6dc-af92-4cf2-ac14-a789f37f7ac5 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:08.325205 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ed39d6dc-af92-4cf2-ac14-a789f37f7ac5 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:08.333323 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ed39d6dc-af92-4cf2-ac14-a789f37f7ac5 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.333783 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ed39d6dc-af92-4cf2-ac14-a789f37f7ac5 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.334549 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ed39d6dc-af92-4cf2-ac14-a789f37f7ac5 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.335024 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ed39d6dc-af92-4cf2-ac14-a789f37f7ac5 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.420570 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-58bfea1c-335d-4e7f-b238-adf8b4dd63e1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:08.421409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-58bfea1c-335d-4e7f-b238-adf8b4dd63e1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:08.427520 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-58bfea1c-335d-4e7f-b238-adf8b4dd63e1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.427984 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-58bfea1c-335d-4e7f-b238-adf8b4dd63e1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.428772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-58bfea1c-335d-4e7f-b238-adf8b4dd63e1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.429218 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-58bfea1c-335d-4e7f-b238-adf8b4dd63e1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.514286 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-ed39d6dc-af92-4cf2-ac14-a789f37f7ac5 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:08.522449 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ed39d6dc-af92-4cf2-ac14-a789f37f7ac5 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.203457 Jun 07 13:28:08.523069 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 484/995] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:08 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:08.578769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-58bfea1c-335d-4e7f-b238-adf8b4dd63e1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:08.586543 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-58bfea1c-335d-4e7f-b238-adf8b4dd63e1 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1547 microversion: 2.1 time: 0.171097 Jun 07 13:28:08.587360 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 512/996] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:08 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:08.605036 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9942a63c-d10b-4b42-b27e-9d7db460771f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:08.605549 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9942a63c-d10b-4b42-b27e-9d7db460771f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:08.612452 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9942a63c-d10b-4b42-b27e-9d7db460771f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.612993 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9942a63c-d10b-4b42-b27e-9d7db460771f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.613974 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9942a63c-d10b-4b42-b27e-9d7db460771f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:08.614463 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9942a63c-d10b-4b42-b27e-9d7db460771f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:08.693970 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9942a63c-d10b-4b42-b27e-9d7db460771f tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093283 Jun 07 13:28:08.694600 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 485/997] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Jun 7 13:28:08 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:09.300091 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-31112d13-1bc2-42f1-84b1-2cde9686abb0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:09.300630 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-31112d13-1bc2-42f1-84b1-2cde9686abb0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:09.307463 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-31112d13-1bc2-42f1-84b1-2cde9686abb0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:09.307926 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-31112d13-1bc2-42f1-84b1-2cde9686abb0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:09.308714 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-31112d13-1bc2-42f1-84b1-2cde9686abb0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:09.309176 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-31112d13-1bc2-42f1-84b1-2cde9686abb0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:09.336100 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-31112d13-1bc2-42f1-84b1-2cde9686abb0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:28:09.437414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-31112d13-1bc2-42f1-84b1-2cde9686abb0 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "DELETE /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 204 len: 0 microversion: 2.1 time: 0.140956 Jun 07 13:28:09.438326 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 513/998] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:09 2022] DELETE /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:28:09.448865 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fcd0f8f9-0293-4649-80ea-79c455353ed8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:09.449486 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fcd0f8f9-0293-4649-80ea-79c455353ed8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:09.453107 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:09.458874 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fcd0f8f9-0293-4649-80ea-79c455353ed8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:09.459328 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fcd0f8f9-0293-4649-80ea-79c455353ed8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:09.460112 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fcd0f8f9-0293-4649-80ea-79c455353ed8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:09.460550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fcd0f8f9-0293-4649-80ea-79c455353ed8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:09.540775 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7dc3c031-e879-4a66-bede-165b449185be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:09.541481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7dc3c031-e879-4a66-bede-165b449185be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:09.548074 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7dc3c031-e879-4a66-bede-165b449185be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:09.548526 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7dc3c031-e879-4a66-bede-165b449185be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:09.549296 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7dc3c031-e879-4a66-bede-165b449185be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:09.549736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7dc3c031-e879-4a66-bede-165b449185be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:09.749302 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fcd0f8f9-0293-4649-80ea-79c455353ed8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:09.757322 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fcd0f8f9-0293-4649-80ea-79c455353ed8 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1513 microversion: 2.1 time: 0.313478 Jun 07 13:28:09.758045 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 486/999] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:09 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:09.836204 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7dc3c031-e879-4a66-bede-165b449185be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:09.845366 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7dc3c031-e879-4a66-bede-165b449185be tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.308683 Jun 07 13:28:09.846058 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 514/1000] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:09 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:10.036100 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-69a09c3c-f5a8-425d-b337-85a6687cd323 req-96e654a2-593f-41e9-91b5-b4455e762d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24d9423-098a-4175-8de5-832b703e7bf5", "tag": "985ab1c0-0915-4d8d-ae21-d4b38500b6a3"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:10.044653 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-69a09c3c-f5a8-425d-b337-85a6687cd323 req-96e654a2-593f-41e9-91b5-b4455e762d0f service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:10.045095 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-69a09c3c-f5a8-425d-b337-85a6687cd323 req-96e654a2-593f-41e9-91b5-b4455e762d0f service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:10.056920 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-69a09c3c-f5a8-425d-b337-85a6687cd323 req-96e654a2-593f-41e9-91b5-b4455e762d0f service nova] Creating event network-changed:985ab1c0-0915-4d8d-ae21-d4b38500b6a3 for instance f24d9423-098a-4175-8de5-832b703e7bf5 on hv-cinder-84460 Jun 07 13:28:10.062095 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-69a09c3c-f5a8-425d-b337-85a6687cd323 req-96e654a2-593f-41e9-91b5-b4455e762d0f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029622 Jun 07 13:28:10.062715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 487/1001] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:10.778027 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0d0e1bba-146f-4ddd-a4f0-07579dad7ada tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:10.778654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0d0e1bba-146f-4ddd-a4f0-07579dad7ada tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:10.785659 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0d0e1bba-146f-4ddd-a4f0-07579dad7ada tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:10.786119 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0d0e1bba-146f-4ddd-a4f0-07579dad7ada tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:10.786942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0d0e1bba-146f-4ddd-a4f0-07579dad7ada tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:10.787420 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0d0e1bba-146f-4ddd-a4f0-07579dad7ada tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:10.865488 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e74b4cab-9574-4b8c-884a-5188c2b72568 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:10.866362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e74b4cab-9574-4b8c-884a-5188c2b72568 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:10.873362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e74b4cab-9574-4b8c-884a-5188c2b72568 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:10.873901 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e74b4cab-9574-4b8c-884a-5188c2b72568 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:10.874855 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e74b4cab-9574-4b8c-884a-5188c2b72568 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:10.875390 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e74b4cab-9574-4b8c-884a-5188c2b72568 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:10.902691 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:11.037111 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0d0e1bba-146f-4ddd-a4f0-07579dad7ada tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:11.045406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0d0e1bba-146f-4ddd-a4f0-07579dad7ada tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1513 microversion: 2.1 time: 0.271391 Jun 07 13:28:11.046241 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 515/1002] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:10 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:11.181995 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e74b4cab-9574-4b8c-884a-5188c2b72568 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:11.190302 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e74b4cab-9574-4b8c-884a-5188c2b72568 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.329458 Jun 07 13:28:11.191509 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 488/1003] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:10 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:11.545999 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-52af3a4a-63f1-409f-a149-ac49bd76258b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:11.546510 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-52af3a4a-63f1-409f-a149-ac49bd76258b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:11.552732 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-52af3a4a-63f1-409f-a149-ac49bd76258b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:11.553443 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-52af3a4a-63f1-409f-a149-ac49bd76258b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:11.554401 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-52af3a4a-63f1-409f-a149-ac49bd76258b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:11.555057 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-52af3a4a-63f1-409f-a149-ac49bd76258b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:11.574102 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:11.586210 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-52af3a4a-63f1-409f-a149-ac49bd76258b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:28:11.677292 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-52af3a4a-63f1-409f-a149-ac49bd76258b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "DELETE /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 204 len: 0 microversion: 2.1 time: 0.135120 Jun 07 13:28:11.678087 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 516/1004] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:11 2022] DELETE /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:28:11.686015 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-286073a1-0a64-4cdc-abf8-79a297b0d1cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:11.686958 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-286073a1-0a64-4cdc-abf8-79a297b0d1cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:11.693200 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-286073a1-0a64-4cdc-abf8-79a297b0d1cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:11.693652 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-286073a1-0a64-4cdc-abf8-79a297b0d1cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:11.694414 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-286073a1-0a64-4cdc-abf8-79a297b0d1cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:11.695042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-286073a1-0a64-4cdc-abf8-79a297b0d1cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:11.845061 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-286073a1-0a64-4cdc-abf8-79a297b0d1cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:11.852892 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-286073a1-0a64-4cdc-abf8-79a297b0d1cf tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1578 microversion: 2.1 time: 0.170673 Jun 07 13:28:11.853651 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 489/1005] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:11 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:12.063533 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-11b14b3b-37f3-45db-a51d-141e7b7017d9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:12.065214 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-11b14b3b-37f3-45db-a51d-141e7b7017d9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:12.079037 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-11b14b3b-37f3-45db-a51d-141e7b7017d9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:12.079908 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-11b14b3b-37f3-45db-a51d-141e7b7017d9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:12.080855 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-11b14b3b-37f3-45db-a51d-141e7b7017d9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:12.085014 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-11b14b3b-37f3-45db-a51d-141e7b7017d9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:12.086293 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-30047799-49f9-4aff-a477-df65dcf81637 req-019829bb-c201-4cbb-9424-a167c7c9ca5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e44fbd-542f-491b-924a-b344febacc9e", "tag": "d6ca44d9-1b5d-4453-991d-603401049b3a"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:12.104237 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-30047799-49f9-4aff-a477-df65dcf81637 req-019829bb-c201-4cbb-9424-a167c7c9ca5a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:12.108542 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-30047799-49f9-4aff-a477-df65dcf81637 req-019829bb-c201-4cbb-9424-a167c7c9ca5a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:12.122787 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-30047799-49f9-4aff-a477-df65dcf81637 req-019829bb-c201-4cbb-9424-a167c7c9ca5a service nova] Creating event network-changed:d6ca44d9-1b5d-4453-991d-603401049b3a for instance 64e44fbd-542f-491b-924a-b344febacc9e on hv-cinder-84460 Jun 07 13:28:12.127709 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-30047799-49f9-4aff-a477-df65dcf81637 req-019829bb-c201-4cbb-9424-a167c7c9ca5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050387 Jun 07 13:28:12.128561 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 490/1006] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:12.134580 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-07ca14d3-6c63-4fb5-b1fc-1e7bbf059b16 req-e67a622a-a729-4e6c-bd6a-857acec14b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283b33da-e8e6-410d-ad5f-c2cf46a745f3", "name": "network-vif-deleted", "tag": "4c14653f-ef76-4b3c-9ecd-883ef3aced8d"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:12.143679 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-07ca14d3-6c63-4fb5-b1fc-1e7bbf059b16 req-e67a622a-a729-4e6c-bd6a-857acec14b94 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:12.144134 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-07ca14d3-6c63-4fb5-b1fc-1e7bbf059b16 req-e67a622a-a729-4e6c-bd6a-857acec14b94 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:12.158638 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-07ca14d3-6c63-4fb5-b1fc-1e7bbf059b16 req-e67a622a-a729-4e6c-bd6a-857acec14b94 service nova] Creating event network-vif-deleted:4c14653f-ef76-4b3c-9ecd-883ef3aced8d for instance 283b33da-e8e6-410d-ad5f-c2cf46a745f3 on hv-cinder-84460 Jun 07 13:28:12.164319 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-07ca14d3-6c63-4fb5-b1fc-1e7bbf059b16 req-e67a622a-a729-4e6c-bd6a-857acec14b94 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034025 Jun 07 13:28:12.165697 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 491/1007] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:12.177520 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-11b14b3b-37f3-45db-a51d-141e7b7017d9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:12.188809 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-11b14b3b-37f3-45db-a51d-141e7b7017d9 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1471 microversion: 2.1 time: 0.130596 Jun 07 13:28:12.190190 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 517/1008] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:12 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1471 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:12.209579 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-8b09c70e-9fb4-455d-b02e-2f298322573b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:12.210681 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-8b09c70e-9fb4-455d-b02e-2f298322573b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:12.219852 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8b09c70e-9fb4-455d-b02e-2f298322573b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:12.220837 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8b09c70e-9fb4-455d-b02e-2f298322573b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:12.222376 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8b09c70e-9fb4-455d-b02e-2f298322573b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:12.223999 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-8b09c70e-9fb4-455d-b02e-2f298322573b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:12.384782 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-8b09c70e-9fb4-455d-b02e-2f298322573b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:12.393706 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-8b09c70e-9fb4-455d-b02e-2f298322573b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1757 microversion: 2.1 time: 0.189326 Jun 07 13:28:12.394298 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 492/1009] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:12 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:12.870745 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a78e048b-8729-4b37-8f03-2360ee4c9f8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:12.871323 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a78e048b-8729-4b37-8f03-2360ee4c9f8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:12.877409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a78e048b-8729-4b37-8f03-2360ee4c9f8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:12.877863 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a78e048b-8729-4b37-8f03-2360ee4c9f8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:12.878627 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a78e048b-8729-4b37-8f03-2360ee4c9f8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:12.879094 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a78e048b-8729-4b37-8f03-2360ee4c9f8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:13.008975 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a78e048b-8729-4b37-8f03-2360ee4c9f8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:13.016873 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a78e048b-8729-4b37-8f03-2360ee4c9f8b tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1578 microversion: 2.1 time: 0.150097 Jun 07 13:28:13.017445 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 518/1010] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:12 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:13.206741 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-dfc18415-89bf-4d24-b8a1-47aa5800a4c4 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:13.207320 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-dfc18415-89bf-4d24-b8a1-47aa5800a4c4 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:13.213798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dfc18415-89bf-4d24-b8a1-47aa5800a4c4 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:13.214243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dfc18415-89bf-4d24-b8a1-47aa5800a4c4 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:13.215024 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dfc18415-89bf-4d24-b8a1-47aa5800a4c4 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:13.215457 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dfc18415-89bf-4d24-b8a1-47aa5800a4c4 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:13.275365 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-dfc18415-89bf-4d24-b8a1-47aa5800a4c4 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '625ae02165844f9baa4d6672eafbb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004938108be44fd8367b8fae5592613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:13.283384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-dfc18415-89bf-4d24-b8a1-47aa5800a4c4 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 200 len: 1303 microversion: 2.1 time: 0.080528 Jun 07 13:28:13.283948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 493/1011] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:13 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 1303 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:13.410054 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1433f038-6ddf-4f36-b64f-a2588d060cd1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:13.410678 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1433f038-6ddf-4f36-b64f-a2588d060cd1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:13.417267 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1433f038-6ddf-4f36-b64f-a2588d060cd1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:13.417725 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1433f038-6ddf-4f36-b64f-a2588d060cd1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:13.418497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1433f038-6ddf-4f36-b64f-a2588d060cd1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:13.418966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1433f038-6ddf-4f36-b64f-a2588d060cd1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:13.567183 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-1433f038-6ddf-4f36-b64f-a2588d060cd1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:13.575200 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1433f038-6ddf-4f36-b64f-a2588d060cd1 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1760 microversion: 2.1 time: 0.168960 Jun 07 13:28:13.576409 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 519/1012] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:13 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:14.033446 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1083d4f5-1e90-495d-9958-187ebf2d3445 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:14.033983 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1083d4f5-1e90-495d-9958-187ebf2d3445 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:14.040012 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1083d4f5-1e90-495d-9958-187ebf2d3445 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:14.040460 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1083d4f5-1e90-495d-9958-187ebf2d3445 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:14.041231 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1083d4f5-1e90-495d-9958-187ebf2d3445 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:14.041642 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1083d4f5-1e90-495d-9958-187ebf2d3445 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:14.182328 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-1083d4f5-1e90-495d-9958-187ebf2d3445 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:14.191193 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1083d4f5-1e90-495d-9958-187ebf2d3445 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1578 microversion: 2.1 time: 0.161617 Jun 07 13:28:14.191995 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 494/1013] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:14 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:14.300884 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:14.301544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] [instance: 283b33da-e8e6-410d-ad5f-c2cf46a745f3] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:14.307819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:14.308344 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:14.309209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:14.309770 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:14.324129 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] HTTP exception thrown: Instance 283b33da-e8e6-410d-ad5f-c2cf46a745f3 could not be found. Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Request method failure captured: Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 HTTP/1.1 Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1H6YJoUQZ1pKkG-j_c3YlNqf7-AsSwIkFcJGSTCLLwV3P445SsThL_VfSkooXtIdSf6ZEHVa4ykZ08MYLdpojc5KOKoYPodYwPRV2PDP1oUZYrMLg0NnvfTMz5Fzeu3uTEcCQO_KOh4ekViO1OT95F4hyU3Hqd9-xRzhbZUUc4ttk4 Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: a004938108be44fd8367b8fae5592613 Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-VolumesSnapshotTestJSON-780415391 Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:28:14.326016 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a004938108be44fd8367b8fae5592613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a004938108be44fd8367b8fae5592613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a004938108be44fd8367b8fae5592613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a004938108be44fd8367b8fae5592613"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-VolumesSnapshotTestJSON-780415391 Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: a004938108be44fd8367b8fae5592613 Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-780415391 Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-VolumesSnapshotTestJSON-780415391-project Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 625ae02165844f9baa4d6672eafbb6d6 Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-VolumesSnapshotTestJSON-780415391-project Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 283b33da-e8e6-410d-ad5f-c2cf46a745f3 could not be found. Jun 07 13:28:14.327481 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '283b33da-e8e6-410d-ad5f-c2cf46a745f3'} Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283b33da-e8e6-410d-ad5f-c2cf46a745f3 could not be found. Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:14.328316 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283b33da-e8e6-410d-ad5f-c2cf46a745f3 could not be found. Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283b33da-e8e6-410d-ad5f-c2cf46a745f3 could not be found. Jun 07 13:28:14.329654 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:14.331099 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] Returning 404 to user: Instance 283b33da-e8e6-410d-ad5f-c2cf46a745f3 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:14.331099 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-5dfd0e59-bbfe-4598-84cf-a2b0e4467863 tempest-VolumesSnapshotTestJSON-780415391 tempest-VolumesSnapshotTestJSON-780415391-project] 10.222.0.61 "GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3" status: 404 len: 111 microversion: 2.1 time: 0.030610 Jun 07 13:28:14.332118 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 520/1014] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:14 2022] GET /compute/v2.1/servers/283b33da-e8e6-410d-ad5f-c2cf46a745f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:14.884790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-4b27469e-d18a-4721-b6b7-6e4e50e41d56 req-1505d5a8-b43c-4c05-b6a1-c378eb4951e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e44fbd-542f-491b-924a-b344febacc9e", "name": "network-vif-deleted", "tag": "d6ca44d9-1b5d-4453-991d-603401049b3a"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:14.894899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-4b27469e-d18a-4721-b6b7-6e4e50e41d56 req-1505d5a8-b43c-4c05-b6a1-c378eb4951e5 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:14.896263 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-4b27469e-d18a-4721-b6b7-6e4e50e41d56 req-1505d5a8-b43c-4c05-b6a1-c378eb4951e5 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:14.910598 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-4b27469e-d18a-4721-b6b7-6e4e50e41d56 req-1505d5a8-b43c-4c05-b6a1-c378eb4951e5 service nova] Creating event network-vif-deleted:d6ca44d9-1b5d-4453-991d-603401049b3a for instance 64e44fbd-542f-491b-924a-b344febacc9e on hv-cinder-84460 Jun 07 13:28:14.916758 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-4b27469e-d18a-4721-b6b7-6e4e50e41d56 req-1505d5a8-b43c-4c05-b6a1-c378eb4951e5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034847 Jun 07 13:28:14.918033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 495/1015] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:28:15.208636 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cdd6675d-95d2-47e8-9af7-47e7e099af5f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:15.209430 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-cdd6675d-95d2-47e8-9af7-47e7e099af5f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:15.216644 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cdd6675d-95d2-47e8-9af7-47e7e099af5f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:15.217259 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cdd6675d-95d2-47e8-9af7-47e7e099af5f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:15.218155 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cdd6675d-95d2-47e8-9af7-47e7e099af5f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:15.218700 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cdd6675d-95d2-47e8-9af7-47e7e099af5f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:15.287962 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-cdd6675d-95d2-47e8-9af7-47e7e099af5f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c5458a18f146be87207e0f6dd598eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562a09561af4197bf2835b31a9dd34e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:15.296397 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-cdd6675d-95d2-47e8-9af7-47e7e099af5f tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 200 len: 1226 microversion: 2.1 time: 0.091763 Jun 07 13:28:15.297075 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 521/1016] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:15 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:16.314572 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:16.315298 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 64e44fbd-542f-491b-924a-b344febacc9e] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:16.321562 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:16.322100 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:16.322969 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:16.323445 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:16.337498 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] HTTP exception thrown: Instance 64e44fbd-542f-491b-924a-b344febacc9e could not be found. Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Request method failure captured: Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e HTTP/1.1 Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1Ca-DPRahE7U6wJfA_TS-oddu6O-I73txX2u1Z2sWh9wI856WP-g2rdzQTuyTYDTEsKT86KtHt5mFZC7ZjmG2A6p5iFaovEpl4sbNcAMXBD2X5lL7oKsxMeskoazifQIHdqq8xL_51ABA9Y5ktloFNZdQUMH_u7l3HLHnidXlTm38k Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:28:16.339123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 36c5458a18f146be87207e0f6dd598eb Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 64e44fbd-542f-491b-924a-b344febacc9e could not be found. Jun 07 13:28:16.340765 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '64e44fbd-542f-491b-924a-b344febacc9e'} Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e44fbd-542f-491b-924a-b344febacc9e could not be found. Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:16.341656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e44fbd-542f-491b-924a-b344febacc9e could not be found. Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e44fbd-542f-491b-924a-b344febacc9e could not be found. Jun 07 13:28:16.343274 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.344587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Returning 404 to user: Instance 64e44fbd-542f-491b-924a-b344febacc9e could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:16.344587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2cc1eaaf-ac94-463e-8d6f-c926f2976891 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e" status: 404 len: 111 microversion: 2.1 time: 0.030864 Jun 07 13:28:16.344587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 496/1017] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:16 2022] GET /compute/v2.1/servers/64e44fbd-542f-491b-924a-b344febacc9e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:16.774624 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:16.775159 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:16.781985 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:16.782444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:16.783250 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:16.783690 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:16.798038 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] HTTP exception thrown: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Request method failure captured: Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: DELETE /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd HTTP/1.1 Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1Ca-DPRahE7U6wJfA_TS-oddu6O-I73txX2u1Z2sWh9wI856WP-g2rdzQTuyTYDTEsKT86KtHt5mFZC7ZjmG2A6p5iFaovEpl4sbNcAMXBD2X5lL7oKsxMeskoazifQIHdqq8xL_51ABA9Y5ktloFNZdQUMH_u7l3HLHnidXlTm38k Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:28:16.799641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 36c5458a18f146be87207e0f6dd598eb Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.801237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '2015ad36-8c9d-42a6-b493-ebed58fb80bd'} Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:16.802157 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.803652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.805209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Returning 404 to user: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:16.805209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3e8bfe80-dbed-4a3a-8fa5-f908735a7226 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 404 len: 111 microversion: 2.1 time: 0.030594 Jun 07 13:28:16.805209 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 522/1018] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:16 2022] DELETE /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:16.810520 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:16.811162 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] [instance: 2015ad36-8c9d-42a6-b493-ebed58fb80bd] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:16.817097 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:16.817546 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:16.818310 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:16.818746 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:16.831829 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] HTTP exception thrown: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Request method failure captured: Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd HTTP/1.1 Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1Ca-DPRahE7U6wJfA_TS-oddu6O-I73txX2u1Z2sWh9wI856WP-g2rdzQTuyTYDTEsKT86KtHt5mFZC7ZjmG2A6p5iFaovEpl4sbNcAMXBD2X5lL7oKsxMeskoazifQIHdqq8xL_51ABA9Y5ktloFNZdQUMH_u7l3HLHnidXlTm38k Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:28:16.833353 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b562a09561af4197bf2835b31a9dd34e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: b562a09561af4197bf2835b31a9dd34e Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-TestVolumeBootPattern-1150014360 Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 36c5458a18f146be87207e0f6dd598eb Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-TestVolumeBootPattern-1150014360-project Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.834948 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '2015ad36-8c9d-42a6-b493-ebed58fb80bd'} Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:16.835836 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. Jun 07 13:28:16.837317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:28:16.838633 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Returning 404 to user: Instance 2015ad36-8c9d-42a6-b493-ebed58fb80bd could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:16.838633 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1422887c-7544-43a6-b472-4f35ea789475 tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd" status: 404 len: 111 microversion: 2.1 time: 0.028579 Jun 07 13:28:16.838633 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 497/1019] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:16 2022] GET /compute/v2.1/servers/2015ad36-8c9d-42a6-b493-ebed58fb80bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:19.187922 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-352a9e26-03ec-48cf-9c76-a43203f9030c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] Calling method '.version_select at 0x7f46a81bbca0>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:19.211414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-352a9e26-03ec-48cf-9c76-a43203f9030c tempest-TestVolumeBootPattern-1150014360 tempest-TestVolumeBootPattern-1150014360-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1670039504" status: 202 len: 0 microversion: 2.1 time: 0.027160 Jun 07 13:28:19.212227 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 523/1020] 10.222.0.61 () {58 vars in 1262 bytes} [Tue Jun 7 13:28:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1670039504 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:28:52.534155 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-00f1c237-c143-40fd-864b-e4aaad0c1746 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1146177753"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:52.534690 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-00f1c237-c143-40fd-864b-e4aaad0c1746 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:52.537163 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=23 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:52.537798 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=36 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:52.543873 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-00f1c237-c143-40fd-864b-e4aaad0c1746 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:52.544323 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-00f1c237-c143-40fd-864b-e4aaad0c1746 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:52.545086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-00f1c237-c143-40fd-864b-e4aaad0c1746 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:52.545518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-00f1c237-c143-40fd-864b-e4aaad0c1746 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:52.673247 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.network.security_group_api [None req-00f1c237-c143-40fd-864b-e4aaad0c1746 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Removing security group dc49ce17-8053-4c2c-8297-12899710fcfb from port bed14a51-6d9f-4196-acb1-a90c45346c0d Jun 07 13:28:53.039177 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-00f1c237-c143-40fd-864b-e4aaad0c1746 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "POST /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/action" status: 202 len: 0 microversion: 2.1 time: 0.509647 Jun 07 13:28:53.043384 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 498/1021] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:28:52 2022] POST /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:28:53.047822 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-87e496c0-edd5-48ce-8411-b822f2672697 req-53d359a4-8a1b-4519-9e8c-35dcc319c54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5973b7d3-2066-44b6-926a-4c4cefe97e9a", "tag": "bed14a51-6d9f-4196-acb1-a90c45346c0d"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:53.053650 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:53.053650 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:53.068282 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-87e496c0-edd5-48ce-8411-b822f2672697 req-53d359a4-8a1b-4519-9e8c-35dcc319c54a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:53.068973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-87e496c0-edd5-48ce-8411-b822f2672697 req-53d359a4-8a1b-4519-9e8c-35dcc319c54a service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:53.100399 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-87e496c0-edd5-48ce-8411-b822f2672697 req-53d359a4-8a1b-4519-9e8c-35dcc319c54a service nova] Creating event network-changed:bed14a51-6d9f-4196-acb1-a90c45346c0d for instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a on hv-cinder-84460 Jun 07 13:28:53.107845 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-87e496c0-edd5-48ce-8411-b822f2672697 req-53d359a4-8a1b-4519-9e8c-35dcc319c54a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063543 Jun 07 13:28:53.109207 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 524/1022] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:53.931313 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e40f4a81-371a-4576-84dd-0e8a58f015b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:53.932532 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e40f4a81-371a-4576-84dd-0e8a58f015b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:53.939859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e40f4a81-371a-4576-84dd-0e8a58f015b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:53.940312 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e40f4a81-371a-4576-84dd-0e8a58f015b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:53.941432 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e40f4a81-371a-4576-84dd-0e8a58f015b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:53.945529 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e40f4a81-371a-4576-84dd-0e8a58f015b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:53.970281 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e40f4a81-371a-4576-84dd-0e8a58f015b9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/ips" status: 200 len: 146 microversion: 2.1 time: 0.223302 Jun 07 13:28:53.970761 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 499/1023] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Jun 7 13:28:53 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/ips => generated 146 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:54.150210 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2f88f466-c147-4d2b-847f-b02294940bb9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:54.150786 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2f88f466-c147-4d2b-847f-b02294940bb9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:54.158695 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f88f466-c147-4d2b-847f-b02294940bb9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:54.159187 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f88f466-c147-4d2b-847f-b02294940bb9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:54.160239 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f88f466-c147-4d2b-847f-b02294940bb9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:54.160683 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2f88f466-c147-4d2b-847f-b02294940bb9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:54.274419 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-2f88f466-c147-4d2b-847f-b02294940bb9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lazy-loading 'services' on Instance uuid 5973b7d3-2066-44b6-926a-4c4cefe97e9a {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:28:54.353573 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2f88f466-c147-4d2b-847f-b02294940bb9 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments/2dfd626a-8007-4da8-b703-2af6f95dc545" status: 202 len: 0 microversion: 2.1 time: 0.208423 Jun 07 13:28:54.354649 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 525/1024] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:28:54 2022] DELETE /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments/2dfd626a-8007-4da8-b703-2af6f95dc545 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:28:54.363156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c040239b-8c4e-4de6-af48-21448394dd88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:54.364156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c040239b-8c4e-4de6-af48-21448394dd88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:54.370328 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c040239b-8c4e-4de6-af48-21448394dd88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:54.371496 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c040239b-8c4e-4de6-af48-21448394dd88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:54.372389 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c040239b-8c4e-4de6-af48-21448394dd88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:54.372839 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c040239b-8c4e-4de6-af48-21448394dd88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:54.405541 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c040239b-8c4e-4de6-af48-21448394dd88 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Jun 07 13:28:54.406305 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 500/1025] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:28:54 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:55.125237 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-4d22991c-9e7b-4c56-bf7b-256999925790 req-8e67be34-130f-4259-906d-3c5bbaefe2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5973b7d3-2066-44b6-926a-4c4cefe97e9a", "tag": "bed14a51-6d9f-4196-acb1-a90c45346c0d"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:55.135042 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-4d22991c-9e7b-4c56-bf7b-256999925790 req-8e67be34-130f-4259-906d-3c5bbaefe2d9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.135497 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-4d22991c-9e7b-4c56-bf7b-256999925790 req-8e67be34-130f-4259-906d-3c5bbaefe2d9 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.147830 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-4d22991c-9e7b-4c56-bf7b-256999925790 req-8e67be34-130f-4259-906d-3c5bbaefe2d9 service nova] Creating event network-changed:bed14a51-6d9f-4196-acb1-a90c45346c0d for instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a on hv-cinder-84460 Jun 07 13:28:55.155289 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-4d22991c-9e7b-4c56-bf7b-256999925790 req-8e67be34-130f-4259-906d-3c5bbaefe2d9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033425 Jun 07 13:28:55.156220 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 526/1026] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:55.317656 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-d541afd1-52a9-4de9-8bdf-e7722bf468af tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dbad9c4-1cf5-4e2f-b3ad-db816b9f9dd6"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:55.318816 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-d541afd1-52a9-4de9-8bdf-e7722bf468af tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:55.325523 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d541afd1-52a9-4de9-8bdf-e7722bf468af tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.326028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d541afd1-52a9-4de9-8bdf-e7722bf468af tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.327033 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d541afd1-52a9-4de9-8bdf-e7722bf468af tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.327633 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-d541afd1-52a9-4de9-8bdf-e7722bf468af tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.418717 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-6e596166-3e73-4a2c-95f5-4122bf7f3150 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:55.419767 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-6e596166-3e73-4a2c-95f5-4122bf7f3150 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:55.429985 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e596166-3e73-4a2c-95f5-4122bf7f3150 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.430444 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e596166-3e73-4a2c-95f5-4122bf7f3150 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.431255 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e596166-3e73-4a2c-95f5-4122bf7f3150 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.431940 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-6e596166-3e73-4a2c-95f5-4122bf7f3150 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.466999 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-6e596166-3e73-4a2c-95f5-4122bf7f3150 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053162 Jun 07 13:28:55.468153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 527/1027] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:28:55 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 13:28:55.478475 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:55.479269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:55.486878 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.487831 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.488095 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:55.488530 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:55.581075 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] HTTP exception thrown: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a is not attached to volume 2dfd626a-8007-4da8-b703-2af6f95dc545 Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Request method failure captured: Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: DELETE /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments/2dfd626a-8007-4da8-b703-2af6f95dc545 HTTP/1.1 Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1HtufGowSqNPclMNR5WGV3y2-RCOlm9TvVEEAxJdTN62jPE1Mn7xUh0wpm27btWYvgNcgx34pGIoUQB-M8DK00XHAnlHrjW9Q6ObhTmrpCiLszb69WTOPbRKH5riWzzvKmU0fkamtm8zz1BlWvUeFPmTEHmLN0yPJu7CmxOFDtRFOs Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 6f612ecb68c2414f92e3887ffeff0cdd Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-TestMinimumBasicScenario-1210804299 Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:28:55.583521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f612ecb68c2414f92e3887ffeff0cdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6f612ecb68c2414f92e3887ffeff0cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f612ecb68c2414f92e3887ffeff0cdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6f612ecb68c2414f92e3887ffeff0cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-TestMinimumBasicScenario-1210804299 Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 6f612ecb68c2414f92e3887ffeff0cdd Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1210804299 Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-TestMinimumBasicScenario-1210804299-project Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: 0c13da70175548fbbddc42879c3024d5 Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-TestMinimumBasicScenario-1210804299-project Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:28:55.585097 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a is not attached to volume 2dfd626a-8007-4da8-b703-2af6f95dc545 Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'server_id': '5973b7d3-2066-44b6-926a-4c4cefe97e9a', 'id': '2dfd626a-8007-4da8-b703-2af6f95dc545'} Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2dfd626a-8007-4da8-b703-2af6f95dc545. Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:55.586260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a is not attached to volume 2dfd626a-8007-4da8-b703-2af6f95dc545 Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a is not attached to volume 2dfd626a-8007-4da8-b703-2af6f95dc545 Jun 07 13:28:55.587827 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:28:55.590153 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Returning 404 to user: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a is not attached to volume 2dfd626a-8007-4da8-b703-2af6f95dc545 {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:55.591271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8f40be39-aa8e-44b9-bda5-39827cb8f59a tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments/2dfd626a-8007-4da8-b703-2af6f95dc545" status: 404 len: 154 microversion: 2.1 time: 0.117326 Jun 07 13:28:55.592520 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 528/1028] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:28:55 2022] DELETE /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a/os-volume_attachments/2dfd626a-8007-4da8-b703-2af6f95dc545 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:55.609352 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-d541afd1-52a9-4de9-8bdf-e7722bf468af tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295444 Jun 07 13:28:55.610156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 501/1029] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:28:55 2022] POST /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:56.760255 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-8e40771a-6662-489f-83db-3369c39e146b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:56.761281 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8e40771a-6662-489f-83db-3369c39e146b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:56.767812 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8e40771a-6662-489f-83db-3369c39e146b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:56.768270 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8e40771a-6662-489f-83db-3369c39e146b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:56.769038 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8e40771a-6662-489f-83db-3369c39e146b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:56.769476 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-8e40771a-6662-489f-83db-3369c39e146b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:56.795050 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-8e40771a-6662-489f-83db-3369c39e146b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Going to try to terminate instance {{(pid=117843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:28:56.869930 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-8e40771a-6662-489f-83db-3369c39e146b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 204 len: 0 microversion: 2.1 time: 0.112913 Jun 07 13:28:56.871769 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 529/1030] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:56 2022] DELETE /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:28:56.881978 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-66b7e450-a03b-4361-a03b-1c2bc760d523 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:56.882670 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-66b7e450-a03b-4361-a03b-1c2bc760d523 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:56.889640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-66b7e450-a03b-4361-a03b-1c2bc760d523 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:56.890086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-66b7e450-a03b-4361-a03b-1c2bc760d523 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:56.890877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-66b7e450-a03b-4361-a03b-1c2bc760d523 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:56.891317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-66b7e450-a03b-4361-a03b-1c2bc760d523 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:57.020911 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-66b7e450-a03b-4361-a03b-1c2bc760d523 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:57.029225 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-66b7e450-a03b-4361-a03b-1c2bc760d523 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1554 microversion: 2.1 time: 0.152926 Jun 07 13:28:57.029795 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 502/1031] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:56 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:58.046637 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c8b9cff1-17e9-4522-89b9-b1631618aa37 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:58.047295 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c8b9cff1-17e9-4522-89b9-b1631618aa37 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:58.053825 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c8b9cff1-17e9-4522-89b9-b1631618aa37 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:58.054288 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c8b9cff1-17e9-4522-89b9-b1631618aa37 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:58.055113 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c8b9cff1-17e9-4522-89b9-b1631618aa37 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:58.055559 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c8b9cff1-17e9-4522-89b9-b1631618aa37 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:58.190778 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c8b9cff1-17e9-4522-89b9-b1631618aa37 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:58.198518 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c8b9cff1-17e9-4522-89b9-b1631618aa37 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1554 microversion: 2.1 time: 0.156588 Jun 07 13:28:58.199122 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 530/1032] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:58 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:59.216096 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a59db146-ba32-4bc6-93a2-74fcf31f05c6 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:59.216748 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a59db146-ba32-4bc6-93a2-74fcf31f05c6 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:59.223902 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a59db146-ba32-4bc6-93a2-74fcf31f05c6 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:59.224359 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a59db146-ba32-4bc6-93a2-74fcf31f05c6 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:59.225147 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a59db146-ba32-4bc6-93a2-74fcf31f05c6 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:59.225585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a59db146-ba32-4bc6-93a2-74fcf31f05c6 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:59.361322 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a59db146-ba32-4bc6-93a2-74fcf31f05c6 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c13da70175548fbbddc42879c3024d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f612ecb68c2414f92e3887ffeff0cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:59.369120 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a59db146-ba32-4bc6-93a2-74fcf31f05c6 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 200 len: 1554 microversion: 2.1 time: 0.157408 Jun 07 13:28:59.369791 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 503/1033] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:59 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:59.639218 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-11c61c8f-5c9b-49ab-a59b-393e313f439f req-91c9912e-c2f0-4e77-8140-5de7baa7594e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5973b7d3-2066-44b6-926a-4c4cefe97e9a", "name": "network-vif-deleted", "tag": "bed14a51-6d9f-4196-acb1-a90c45346c0d"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:59.648228 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-11c61c8f-5c9b-49ab-a59b-393e313f439f req-91c9912e-c2f0-4e77-8140-5de7baa7594e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:59.648510 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-11c61c8f-5c9b-49ab-a59b-393e313f439f req-91c9912e-c2f0-4e77-8140-5de7baa7594e service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:59.660351 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-11c61c8f-5c9b-49ab-a59b-393e313f439f req-91c9912e-c2f0-4e77-8140-5de7baa7594e service nova] Creating event network-vif-deleted:bed14a51-6d9f-4196-acb1-a90c45346c0d for instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a on hv-cinder-84460 Jun 07 13:28:59.665317 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-11c61c8f-5c9b-49ab-a59b-393e313f439f req-91c9912e-c2f0-4e77-8140-5de7baa7594e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099407 Jun 07 13:28:59.665945 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 531/1034] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:00.386458 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:00.387040 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] [instance: 5973b7d3-2066-44b6-926a-4c4cefe97e9a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:00.393868 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:00.394327 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:00.395135 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:00.395580 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:00.410575 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] HTTP exception thrown: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a could not be found. Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Request method failure captured: Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a HTTP/1.1 Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1HtufGowSqNPclMNR5WGV3y2-RCOlm9TvVEEAxJdTN62jPE1Mn7xUh0wpm27btWYvgNcgx34pGIoUQB-M8DK00XHAnlHrjW9Q6ObhTmrpCiLszb69WTOPbRKH5riWzzvKmU0fkamtm8zz1BlWvUeFPmTEHmLN0yPJu7CmxOFDtRFOs Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 6f612ecb68c2414f92e3887ffeff0cdd Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-TestMinimumBasicScenario-1210804299 Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:29:00.412296 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f612ecb68c2414f92e3887ffeff0cdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6f612ecb68c2414f92e3887ffeff0cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f612ecb68c2414f92e3887ffeff0cdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6f612ecb68c2414f92e3887ffeff0cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-TestMinimumBasicScenario-1210804299 Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 6f612ecb68c2414f92e3887ffeff0cdd Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1210804299 Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-TestMinimumBasicScenario-1210804299-project Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: 0c13da70175548fbbddc42879c3024d5 Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-TestMinimumBasicScenario-1210804299-project Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a could not be found. Jun 07 13:29:00.413859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '5973b7d3-2066-44b6-926a-4c4cefe97e9a'} Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a could not be found. Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:29:00.414772 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a could not be found. Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a could not be found. Jun 07 13:29:00.416399 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:00.417768 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Returning 404 to user: Instance 5973b7d3-2066-44b6-926a-4c4cefe97e9a could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:29:00.417768 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-87f9693b-989a-477e-ba03-58011e20caf7 tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a" status: 404 len: 111 microversion: 2.1 time: 0.032059 Jun 07 13:29:00.417768 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 504/1035] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:00 2022] GET /compute/v2.1/servers/5973b7d3-2066-44b6-926a-4c4cefe97e9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:29:00.423664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-238e2e8a-5d51-449f-bf70-cd853499b90b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] Calling method '.version_select at 0x7f46a35aee50>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:00.444982 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-238e2e8a-5d51-449f-bf70-cd853499b90b tempest-TestMinimumBasicScenario-1210804299 tempest-TestMinimumBasicScenario-1210804299-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-508098056" status: 202 len: 0 microversion: 2.1 time: 0.025638 Jun 07 13:29:00.445565 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 532/1036] 10.222.0.61 () {58 vars in 1268 bytes} [Tue Jun 7 13:29:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-508098056 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:29:03.149137 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-89f647c0-2946-44ae-a493-7cc7224a4506 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:03.150720 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-89f647c0-2946-44ae-a493-7cc7224a4506 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:03.158749 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-89f647c0-2946-44ae-a493-7cc7224a4506 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:03.159587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-89f647c0-2946-44ae-a493-7cc7224a4506 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:03.160586 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-89f647c0-2946-44ae-a493-7cc7224a4506 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:03.161224 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-89f647c0-2946-44ae-a493-7cc7224a4506 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:03.195199 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-89f647c0-2946-44ae-a493-7cc7224a4506 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049965 Jun 07 13:29:03.203678 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 505/1037] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:29:03 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:03.209924 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-dd30a3b6-3e13-4e59-9a72-3ddaa4e399d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:03.211319 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-dd30a3b6-3e13-4e59-9a72-3ddaa4e399d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:03.218732 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd30a3b6-3e13-4e59-9a72-3ddaa4e399d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:03.219238 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd30a3b6-3e13-4e59-9a72-3ddaa4e399d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:03.220015 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd30a3b6-3e13-4e59-9a72-3ddaa4e399d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:03.220477 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-dd30a3b6-3e13-4e59-9a72-3ddaa4e399d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:03.252169 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-dd30a3b6-3e13-4e59-9a72-3ddaa4e399d4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/7dbad9c4-1cf5-4e2f-b3ad-db816b9f9dd6" status: 200 len: 194 microversion: 2.1 time: 0.047064 Jun 07 13:29:03.252765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 533/1038] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Jun 7 13:29:03 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/7dbad9c4-1cf5-4e2f-b3ad-db816b9f9dd6 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:04.602351 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3e9c8ad0-e76d-478c-962c-789c08a8a31c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bdd2a54-a383-44c3-97d2-d1d2dfc80c3e"}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:29:04.603864 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3e9c8ad0-e76d-478c-962c-789c08a8a31c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:04.612441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e9c8ad0-e76d-478c-962c-789c08a8a31c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:04.612894 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e9c8ad0-e76d-478c-962c-789c08a8a31c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:04.614527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e9c8ad0-e76d-478c-962c-789c08a8a31c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:04.614527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e9c8ad0-e76d-478c-962c-789c08a8a31c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:04.887210 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3e9c8ad0-e76d-478c-962c-789c08a8a31c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "POST /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288887 Jun 07 13:29:04.887899 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 506/1039] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Jun 7 13:29:04 2022] POST /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:12.409251 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-01671711-ff38-426b-98d9-4304009b422c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:12.410201 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-01671711-ff38-426b-98d9-4304009b422c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:12.417119 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01671711-ff38-426b-98d9-4304009b422c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:12.417582 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01671711-ff38-426b-98d9-4304009b422c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:12.418998 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01671711-ff38-426b-98d9-4304009b422c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:12.419466 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-01671711-ff38-426b-98d9-4304009b422c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:12.452158 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-01671711-ff38-426b-98d9-4304009b422c tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046832 Jun 07 13:29:12.452933 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 534/1040] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:29:12 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:12.597481 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a80a906a-bf2e-4a90-a74b-08c13671ade9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:12.598258 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a80a906a-bf2e-4a90-a74b-08c13671ade9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:12.604377 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a80a906a-bf2e-4a90-a74b-08c13671ade9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:12.604771 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a80a906a-bf2e-4a90-a74b-08c13671ade9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:12.606134 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a80a906a-bf2e-4a90-a74b-08c13671ade9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:12.606586 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a80a906a-bf2e-4a90-a74b-08c13671ade9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:12.635161 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a80a906a-bf2e-4a90-a74b-08c13671ade9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/7dbad9c4-1cf5-4e2f-b3ad-db816b9f9dd6" status: 200 len: 194 microversion: 2.1 time: 0.042486 Jun 07 13:29:12.635762 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 507/1041] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Jun 7 13:29:12 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/7dbad9c4-1cf5-4e2f-b3ad-db816b9f9dd6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:12.645853 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0a914bcf-a61c-4068-87b4-1173f5e1ec00 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:12.646350 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0a914bcf-a61c-4068-87b4-1173f5e1ec00 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:12.652849 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0a914bcf-a61c-4068-87b4-1173f5e1ec00 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:12.653294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0a914bcf-a61c-4068-87b4-1173f5e1ec00 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:12.654041 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0a914bcf-a61c-4068-87b4-1173f5e1ec00 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:12.654475 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0a914bcf-a61c-4068-87b4-1173f5e1ec00 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:12.734256 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-0a914bcf-a61c-4068-87b4-1173f5e1ec00 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lazy-loading 'services' on Instance uuid f24d9423-098a-4175-8de5-832b703e7bf5 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:29:12.805299 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0a914bcf-a61c-4068-87b4-1173f5e1ec00 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/7dbad9c4-1cf5-4e2f-b3ad-db816b9f9dd6" status: 202 len: 0 microversion: 2.1 time: 0.163546 Jun 07 13:29:12.805912 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 535/1042] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:29:12 2022] DELETE /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/7dbad9c4-1cf5-4e2f-b3ad-db816b9f9dd6 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:29:13.926677 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-ae83853b-6a97-4bbc-bbca-74fe85a83ee3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:13.927365 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-ae83853b-6a97-4bbc-bbca-74fe85a83ee3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:13.934626 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae83853b-6a97-4bbc-bbca-74fe85a83ee3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:13.935193 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae83853b-6a97-4bbc-bbca-74fe85a83ee3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:13.936036 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae83853b-6a97-4bbc-bbca-74fe85a83ee3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:13.936550 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-ae83853b-6a97-4bbc-bbca-74fe85a83ee3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:13.968525 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-ae83853b-6a97-4bbc-bbca-74fe85a83ee3 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/0bdd2a54-a383-44c3-97d2-d1d2dfc80c3e" status: 200 len: 194 microversion: 2.1 time: 0.045878 Jun 07 13:29:13.969302 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 508/1043] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Jun 7 13:29:13 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/0bdd2a54-a383-44c3-97d2-d1d2dfc80c3e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:29:13.979949 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-21e04a8b-e519-43ef-ad5b-f737cce0b72e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:13.981366 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-21e04a8b-e519-43ef-ad5b-f737cce0b72e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:13.987918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-21e04a8b-e519-43ef-ad5b-f737cce0b72e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:13.988373 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-21e04a8b-e519-43ef-ad5b-f737cce0b72e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:13.989144 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-21e04a8b-e519-43ef-ad5b-f737cce0b72e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:13.989584 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-21e04a8b-e519-43ef-ad5b-f737cce0b72e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:14.070245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-21e04a8b-e519-43ef-ad5b-f737cce0b72e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lazy-loading 'services' on Instance uuid f24d9423-098a-4175-8de5-832b703e7bf5 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:29:14.142774 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-21e04a8b-e519-43ef-ad5b-f737cce0b72e tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/0bdd2a54-a383-44c3-97d2-d1d2dfc80c3e" status: 202 len: 0 microversion: 2.1 time: 0.167480 Jun 07 13:29:14.143344 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 536/1044] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Jun 7 13:29:13 2022] DELETE /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments/0bdd2a54-a383-44c3-97d2-d1d2dfc80c3e => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:29:15.300445 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3e43ba27-8f75-4db5-90db-ba9db4ed98e4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:15.302003 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3e43ba27-8f75-4db5-90db-ba9db4ed98e4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:15.309203 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e43ba27-8f75-4db5-90db-ba9db4ed98e4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:15.309660 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e43ba27-8f75-4db5-90db-ba9db4ed98e4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:15.310424 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e43ba27-8f75-4db5-90db-ba9db4ed98e4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:15.310884 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3e43ba27-8f75-4db5-90db-ba9db4ed98e4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:15.339220 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3e43ba27-8f75-4db5-90db-ba9db4ed98e4 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042603 Jun 07 13:29:15.339777 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 509/1045] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:29:15 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:29:15.443116 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-55b1dd53-1ed9-46f4-8621-1533d49c8925 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:15.444182 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-55b1dd53-1ed9-46f4-8621-1533d49c8925 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:15.451177 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55b1dd53-1ed9-46f4-8621-1533d49c8925 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:15.451628 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55b1dd53-1ed9-46f4-8621-1533d49c8925 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:15.452385 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55b1dd53-1ed9-46f4-8621-1533d49c8925 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:15.452819 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55b1dd53-1ed9-46f4-8621-1533d49c8925 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:15.483390 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-55b1dd53-1ed9-46f4-8621-1533d49c8925 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044474 Jun 07 13:29:15.483968 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 537/1046] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Jun 7 13:29:15 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:29:15.539631 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-bf5d744d-f2d0-415f-96c3-66fb1074c336 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:15.540126 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-bf5d744d-f2d0-415f-96c3-66fb1074c336 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:15.546070 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bf5d744d-f2d0-415f-96c3-66fb1074c336 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:15.546522 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bf5d744d-f2d0-415f-96c3-66fb1074c336 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:15.547317 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bf5d744d-f2d0-415f-96c3-66fb1074c336 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:15.547762 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-bf5d744d-f2d0-415f-96c3-66fb1074c336 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:15.572753 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-bf5d744d-f2d0-415f-96c3-66fb1074c336 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Going to try to terminate instance {{(pid=117842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:29:15.647462 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-bf5d744d-f2d0-415f-96c3-66fb1074c336 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 204 len: 0 microversion: 2.1 time: 0.111946 Jun 07 13:29:15.648556 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 510/1047] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:29:15 2022] DELETE /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:29:15.656776 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-7df6643e-3b4c-475e-9d85-f77a3b604f12 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:15.657485 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-7df6643e-3b4c-475e-9d85-f77a3b604f12 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:15.665759 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7df6643e-3b4c-475e-9d85-f77a3b604f12 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:15.666211 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7df6643e-3b4c-475e-9d85-f77a3b604f12 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:15.667011 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7df6643e-3b4c-475e-9d85-f77a3b604f12 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:15.667477 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-7df6643e-3b4c-475e-9d85-f77a3b604f12 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:15.800318 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-7df6643e-3b4c-475e-9d85-f77a3b604f12 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:29:15.807848 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-7df6643e-3b4c-475e-9d85-f77a3b604f12 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1672 microversion: 2.1 time: 0.155012 Jun 07 13:29:15.808414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 538/1048] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:15 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:29:16.826284 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2e2909bf-50cf-4a1e-8ff6-71b42b01fc18 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:16.827014 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2e2909bf-50cf-4a1e-8ff6-71b42b01fc18 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:16.833871 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2e2909bf-50cf-4a1e-8ff6-71b42b01fc18 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:16.834327 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2e2909bf-50cf-4a1e-8ff6-71b42b01fc18 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:16.835204 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2e2909bf-50cf-4a1e-8ff6-71b42b01fc18 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:16.835647 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2e2909bf-50cf-4a1e-8ff6-71b42b01fc18 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:16.854413 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:16.967354 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2e2909bf-50cf-4a1e-8ff6-71b42b01fc18 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:29:16.974925 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2e2909bf-50cf-4a1e-8ff6-71b42b01fc18 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1672 microversion: 2.1 time: 0.152986 Jun 07 13:29:16.975497 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 511/1049] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:16 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:29:17.991610 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-807a434f-2a49-479d-8378-fed40f5f3ecb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:17.992253 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-807a434f-2a49-479d-8378-fed40f5f3ecb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:17.999063 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-807a434f-2a49-479d-8378-fed40f5f3ecb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:17.999521 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-807a434f-2a49-479d-8378-fed40f5f3ecb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:18.000297 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-807a434f-2a49-479d-8378-fed40f5f3ecb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:18.000736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-807a434f-2a49-479d-8378-fed40f5f3ecb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:18.141363 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-807a434f-2a49-479d-8378-fed40f5f3ecb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:29:18.144961 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:18.151117 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-807a434f-2a49-479d-8378-fed40f5f3ecb tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1672 microversion: 2.1 time: 0.163314 Jun 07 13:29:18.151858 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 539/1050] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:17 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:29:18.645860 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-1af0c29d-0e59-4aed-a40d-4be8df362113 req-ddc6055f-d9be-4da2-a029-3183620715a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f24d9423-098a-4175-8de5-832b703e7bf5", "name": "network-vif-deleted", "tag": "985ab1c0-0915-4d8d-ae21-d4b38500b6a3"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:29:18.655542 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-1af0c29d-0e59-4aed-a40d-4be8df362113 req-ddc6055f-d9be-4da2-a029-3183620715a3 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:18.655994 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-1af0c29d-0e59-4aed-a40d-4be8df362113 req-ddc6055f-d9be-4da2-a029-3183620715a3 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:18.670239 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-1af0c29d-0e59-4aed-a40d-4be8df362113 req-ddc6055f-d9be-4da2-a029-3183620715a3 service nova] Creating event network-vif-deleted:985ab1c0-0915-4d8d-ae21-d4b38500b6a3 for instance f24d9423-098a-4175-8de5-832b703e7bf5 on hv-cinder-84460 Jun 07 13:29:18.675436 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-1af0c29d-0e59-4aed-a40d-4be8df362113 req-ddc6055f-d9be-4da2-a029-3183620715a3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033633 Jun 07 13:29:18.676363 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 512/1051] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:19.174219 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:19.174950 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:19.184721 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:19.185346 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:19.186171 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:19.186617 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:19.221308 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:19.222088 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:19.222985 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.objects.instance [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lazy-loading 'fault' on Instance uuid f24d9423-098a-4175-8de5-832b703e7bf5 {{(pid=117843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:29:19.269955 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5766b86063f4955a642ae59e28ee226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5541835571f64b4dbec6cabbbd6b13ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:29:19.278011 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-70d510ea-5b91-493f-b97e-6267386b6e8b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 200 len: 1326 microversion: 2.1 time: 0.112168 Jun 07 13:29:19.278606 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 540/1052] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:19 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:29:20.298660 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:20.299405 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:20.306542 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:20.307036 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:20.307817 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:20.308258 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:20.323611 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] HTTP exception thrown: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Request method failure captured: Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 HTTP/1.1 Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1Fjh8u2Zu9e5lPBeW96COVODxPg-ICO1tj1it2_DjvUmWi84fixCBWpBiBX0Ndqf4YJMw2PBa8ImU62YHuWNhupua0HIg0tpX5091eB9evuFZ6F3490bFNV1wt0LcG9PKIh6M4j23VnKLARt57apmMzbKTWWUykdJ9SgSJd0AWC1Hk Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:29:20.325314 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: a5766b86063f4955a642ae59e28ee226 Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:20.328037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': 'f24d9423-098a-4175-8de5-832b703e7bf5'} Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:29:20.330159 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:20.333143 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:20.334905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Returning 404 to user: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:29:20.334905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-3ae69174-598b-4fd3-a00a-19dbad211ea6 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 404 len: 111 microversion: 2.1 time: 0.034717 Jun 07 13:29:20.334905 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 513/1053] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:20 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:29:20.336885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cd116aef-6ee4-423f-b8ae-18df4bccd6b7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '.version_select at 0x7f46a3798d30>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:20.354110 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-cd116aef-6ee4-423f-b8ae-18df4bccd6b7 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259546808" status: 202 len: 0 microversion: 2.1 time: 0.020996 Jun 07 13:29:20.354690 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 541/1054] 10.222.0.61 () {58 vars in 1217 bytes} [Tue Jun 7 13:29:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259546808 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:29:23.321848 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:23.322372 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:23.324750 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:23.330785 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:23.331299 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:23.332053 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:23.332485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:23.346175 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] HTTP exception thrown: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Request method failure captured: Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 HTTP/1.1 Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1Fjh8u2Zu9e5lPBeW96COVODxPg-ICO1tj1it2_DjvUmWi84fixCBWpBiBX0Ndqf4YJMw2PBa8ImU62YHuWNhupua0HIg0tpX5091eB9evuFZ6F3490bFNV1wt0LcG9PKIh6M4j23VnKLARt57apmMzbKTWWUykdJ9SgSJd0AWC1Hk Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:29:23.347869 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: a5766b86063f4955a642ae59e28ee226 Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.349602 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': 'f24d9423-098a-4175-8de5-832b703e7bf5'} Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:29:23.350518 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.352028 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.353513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Returning 404 to user: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:29:23.353513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9837b1a1-8f36-4557-b677-1d8cc4e8ae43 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 404 len: 111 microversion: 2.1 time: 0.031854 Jun 07 13:29:23.353513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 514/1055] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:29:23 2022] DELETE /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:29:23.358533 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:23.359187 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: f24d9423-098a-4175-8de5-832b703e7bf5] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:23.365241 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:23.365691 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:23.366458 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:23.366943 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:23.382732 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] HTTP exception thrown: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Request method failure captured: Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 HTTP/1.1 Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1Fjh8u2Zu9e5lPBeW96COVODxPg-ICO1tj1it2_DjvUmWi84fixCBWpBiBX0Ndqf4YJMw2PBa8ImU62YHuWNhupua0HIg0tpX5091eB9evuFZ6F3490bFNV1wt0LcG9PKIh6M4j23VnKLARt57apmMzbKTWWUykdJ9SgSJd0AWC1Hk Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:29:23.385173 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: a5766b86063f4955a642ae59e28ee226 Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.386772 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': 'f24d9423-098a-4175-8de5-832b703e7bf5'} Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:29:23.387881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. Jun 07 13:29:23.389728 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:23.391120 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Returning 404 to user: Instance f24d9423-098a-4175-8de5-832b703e7bf5 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:29:23.391120 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-bac81465-0cbc-47db-8a1b-210ecb8a833d tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5" status: 404 len: 111 microversion: 2.1 time: 0.032759 Jun 07 13:29:23.391120 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 542/1056] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:23 2022] GET /compute/v2.1/servers/f24d9423-098a-4175-8de5-832b703e7bf5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:29:24.521517 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:24.522042 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:24.529374 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:24.529828 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:24.530597 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:24.531091 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:24.544581 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.wsgi [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] HTTP exception thrown: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Request method failure captured: Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: request: DELETE /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 HTTP/1.1 Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept: application/json Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Accept-Encoding: identity Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Connection: close Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Length: 0 Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Content-Type: application/json Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Host: 10.222.0.61 Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Openstack-System-Scope: None Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: User-Agent: python-urllib3/1.26.9 Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Auth-Token: gAAAAABin1Fjh8u2Zu9e5lPBeW96COVODxPg-ICO1tj1it2_DjvUmWi84fixCBWpBiBX0Ndqf4YJMw2PBa8ImU62YHuWNhupua0HIg0tpX5091eB9evuFZ6F3490bFNV1wt0LcG9PKIh6M4j23VnKLARt57apmMzbKTWWUykdJ9SgSJd0AWC1Hk Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Id: None Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Domain-Name: None Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Identity-Status: Confirmed Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Is-Admin-Project: True Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Id: default Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Domain-Name: Default Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Project-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Role: member,reader Jun 07 13:29:24.546158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Roles: member,reader Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Id: default Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Domain-Name: Default Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Id: a5766b86063f4955a642ae59e28ee226 Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: X-User-Name: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: method: > Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: exception: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.547883 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: action_args: {'id': '1a5264ef-a5c4-498e-8c65-af627dcfa757'} Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:29:24.548719 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.549956 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.551391 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Returning 404 to user: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. {{(pid=117842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:29:24.551391 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c0a94e5d-e1f9-4a57-a620-2cb28c1b3df9 tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 404 len: 111 microversion: 2.1 time: 0.030003 Jun 07 13:29:24.551391 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 515/1057] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:29:24 2022] DELETE /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:29:24.557303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:24.557998 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] [instance: 1a5264ef-a5c4-498e-8c65-af627dcfa757] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:24.560427 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:24.566783 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:24.567325 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:24.568150 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:24.568587 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:24.584739 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] HTTP exception thrown: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Request method failure captured: Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 HTTP/1.1 Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1Fjh8u2Zu9e5lPBeW96COVODxPg-ICO1tj1it2_DjvUmWi84fixCBWpBiBX0Ndqf4YJMw2PBa8ImU62YHuWNhupua0HIg0tpX5091eB9evuFZ6F3490bFNV1wt0LcG9PKIh6M4j23VnKLARt57apmMzbKTWWUykdJ9SgSJd0AWC1Hk Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:29:24.586271 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5541835571f64b4dbec6cabbbd6b13ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 5541835571f64b4dbec6cabbbd6b13ca Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359524052 Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: a5766b86063f4955a642ae59e28ee226 Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-AttachVolumeTestJSON-1359524052-project Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.587803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': '1a5264ef-a5c4-498e-8c65-af627dcfa757'} Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:29:24.588715 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. Jun 07 13:29:24.590328 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:29:24.591929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] Returning 404 to user: Instance 1a5264ef-a5c4-498e-8c65-af627dcfa757 could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:29:24.591929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a102e73f-8df7-4ae0-a28d-cd20528fa13b tempest-AttachVolumeTestJSON-1359524052 tempest-AttachVolumeTestJSON-1359524052-project] 10.222.0.61 "GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757" status: 404 len: 111 microversion: 2.1 time: 0.035206 Jun 07 13:29:24.591929 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 543/1058] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:24 2022] GET /compute/v2.1/servers/1a5264ef-a5c4-498e-8c65-af627dcfa757 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:30:43.962479 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=3 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:30:43.963766 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=10 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:30:44.226997 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-1f3d4240-e393-4c59-b452-009dcefc3ebf tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Action: 'create', calling method: .version_select at 0x7f46a3722f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1481006062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAs6Hw9f+W1fFtMcV7+yeObJlK85/Z0W/XYPze7l+Jn7GO59dPj8RRbUirJ3U2FLUU/5+UACPSUhfKY+xCyihrZQoUf06RMW5zXbtVjfw+M0s5AiljhEPq8PRM3TI7GtnQ=="}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:30:44.247936 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-1f3d4240-e393-4c59-b452-009dcefc3ebf tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Getting quotas for project 3347761872914cbbb350a639eece5f9f. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:30:44.252100 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.quota [None req-1f3d4240-e393-4c59-b452-009dcefc3ebf tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Getting quotas for user a4b564431e6e4f03ba125f749218777a and project 3347761872914cbbb350a639eece5f9f. Resources: {'key_pairs'} {{(pid=117842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:30:44.265811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1f3d4240-e393-4c59-b452-009dcefc3ebf tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [a45154e6-bffb-4976-98f9-ea7f2196b8a2] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 13:30:45.276342 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO oslo.messaging._drivers.impl_rabbit [None req-1f3d4240-e393-4c59-b452-009dcefc3ebf tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [a45154e6-bffb-4976-98f9-ea7f2196b8a2] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 55012. Jun 07 13:30:45.297104 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-1f3d4240-e393-4c59-b452-009dcefc3ebf tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.336908 Jun 07 13:30:45.302773 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 516/1059] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Jun 7 13:30:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:31:02.737269 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=12 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:31:02.738136 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=1 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:31:02.744117 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1820999969", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1481006062", "security_groups": [{"name": "tempest-secgroup-smoke-100635421"}], "networks": [{"uuid": "b1eee5ac-c97f-4dc1-bbb1-034ecd8eca6f"}], "block_device_mapping_v2": [{"uuid": "d01c1999-67c9-40f0-8523-c07996fc45c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:31:02.878414 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.network.neutron [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] validate_networks() for [('b1eee5ac-c97f-4dc1-bbb1-034ecd8eca6f', None, None, None, None, None)] {{(pid=117843) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:31:03.615951 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Flavor limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:31:03.616448 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Image limits 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:31:03.616937 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Flavor pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:31:03.617357 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Image pref 0:0:0 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:31:03.617776 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.virt.hardware [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:31:03.628512 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:03.628993 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:03.629820 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:03.630263 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:03.648622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Getting quotas for project 3347761872914cbbb350a639eece5f9f. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:31:03.653465 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.quota [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Getting quotas for user a4b564431e6e4f03ba125f749218777a and project 3347761872914cbbb350a639eece5f9f. Resources: {'cores', 'instances', 'ram'} {{(pid=117843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:31:03.712448 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Going to run 1 instances... {{(pid=117843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:31:03.714554 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d01c1999-67c9-40f0-8523-c07996fc45c0',volume_size=None,volume_type=None)] {{(pid=117843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:31:03.857141 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-1ff759b7-ac37-4ba7-b432-a54c9c2714e8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.122165 Jun 07 13:31:03.857843 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 544/1060] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Jun 7 13:31:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:31:03.868594 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a0fe7c5d-6db5-4be1-b951-ff7b29582297 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:03.869215 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a0fe7c5d-6db5-4be1-b951-ff7b29582297 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:03.871300 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=4 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:31:03.873755 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:31:03.935862 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a0fe7c5d-6db5-4be1-b951-ff7b29582297 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:03.943036 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a0fe7c5d-6db5-4be1-b951-ff7b29582297 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1089 microversion: 2.1 time: 0.078461 Jun 07 13:31:03.943543 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 517/1061] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:03 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1089 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:31:04.961083 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-fdce1d2e-f2a1-4575-87b2-77dcf43e5026 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:04.961665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-fdce1d2e-f2a1-4575-87b2-77dcf43e5026 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:04.969100 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fdce1d2e-f2a1-4575-87b2-77dcf43e5026 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:04.969548 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fdce1d2e-f2a1-4575-87b2-77dcf43e5026 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:04.970319 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fdce1d2e-f2a1-4575-87b2-77dcf43e5026 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:04.970746 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-fdce1d2e-f2a1-4575-87b2-77dcf43e5026 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:05.041756 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-fdce1d2e-f2a1-4575-87b2-77dcf43e5026 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:05.052507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-fdce1d2e-f2a1-4575-87b2-77dcf43e5026 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1187 microversion: 2.1 time: 0.095902 Jun 07 13:31:05.060566 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 545/1062] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:04 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:06.073840 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-823a7357-adbd-4e82-9a77-aa3134bfd99a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:06.074513 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-823a7357-adbd-4e82-9a77-aa3134bfd99a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:06.081251 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-823a7357-adbd-4e82-9a77-aa3134bfd99a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:06.081756 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-823a7357-adbd-4e82-9a77-aa3134bfd99a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:06.082570 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-823a7357-adbd-4e82-9a77-aa3134bfd99a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:06.083116 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-823a7357-adbd-4e82-9a77-aa3134bfd99a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:06.217920 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-823a7357-adbd-4e82-9a77-aa3134bfd99a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:06.225801 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-823a7357-adbd-4e82-9a77-aa3134bfd99a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.156638 Jun 07 13:31:06.226374 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 518/1063] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:06 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:06.490460 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-8cf6ebda-5dba-4704-aeeb-45af46be6ee8 req-b4be7c1f-6488-4358-814b-8f1a284b36fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5a2d6e-60e0-4a54-9900-6b40dd6c365a", "tag": "f4e6e8bd-f53b-43db-ad12-957650bf7ac4"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:31:06.500792 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-8cf6ebda-5dba-4704-aeeb-45af46be6ee8 req-b4be7c1f-6488-4358-814b-8f1a284b36fe service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:06.501729 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-8cf6ebda-5dba-4704-aeeb-45af46be6ee8 req-b4be7c1f-6488-4358-814b-8f1a284b36fe service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:06.514822 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-8cf6ebda-5dba-4704-aeeb-45af46be6ee8 req-b4be7c1f-6488-4358-814b-8f1a284b36fe service nova] Creating event network-changed:f4e6e8bd-f53b-43db-ad12-957650bf7ac4 for instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a on hv-cinder-84460 Jun 07 13:31:06.520576 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-8cf6ebda-5dba-4704-aeeb-45af46be6ee8 req-b4be7c1f-6488-4358-814b-8f1a284b36fe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034420 Jun 07 13:31:06.521262 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 546/1064] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:31:07.243494 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-9807af1e-61f3-4d9c-a023-73d33078da01 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:07.244950 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-9807af1e-61f3-4d9c-a023-73d33078da01 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:07.250785 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9807af1e-61f3-4d9c-a023-73d33078da01 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:07.251208 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9807af1e-61f3-4d9c-a023-73d33078da01 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:07.251981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9807af1e-61f3-4d9c-a023-73d33078da01 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:07.252415 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-9807af1e-61f3-4d9c-a023-73d33078da01 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:07.392821 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-9807af1e-61f3-4d9c-a023-73d33078da01 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:07.401398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-9807af1e-61f3-4d9c-a023-73d33078da01 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.161889 Jun 07 13:31:07.402026 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 519/1065] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:07 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:08.419888 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-af9e53b2-9bc8-4d8f-bed0-fb4d4e9547b5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:08.420538 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-af9e53b2-9bc8-4d8f-bed0-fb4d4e9547b5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:08.426973 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af9e53b2-9bc8-4d8f-bed0-fb4d4e9547b5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:08.427422 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af9e53b2-9bc8-4d8f-bed0-fb4d4e9547b5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:08.428192 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af9e53b2-9bc8-4d8f-bed0-fb4d4e9547b5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:08.428627 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-af9e53b2-9bc8-4d8f-bed0-fb4d4e9547b5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:08.566681 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-af9e53b2-9bc8-4d8f-bed0-fb4d4e9547b5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:08.574342 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-af9e53b2-9bc8-4d8f-bed0-fb4d4e9547b5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.159751 Jun 07 13:31:08.574936 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 547/1066] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:08 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:09.591310 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-2b91bf72-0fdd-4068-b79a-3aaa1cca9cd2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:09.591930 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-2b91bf72-0fdd-4068-b79a-3aaa1cca9cd2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:09.598605 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2b91bf72-0fdd-4068-b79a-3aaa1cca9cd2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:09.599110 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2b91bf72-0fdd-4068-b79a-3aaa1cca9cd2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:09.599898 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2b91bf72-0fdd-4068-b79a-3aaa1cca9cd2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:09.600339 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-2b91bf72-0fdd-4068-b79a-3aaa1cca9cd2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:09.740054 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-2b91bf72-0fdd-4068-b79a-3aaa1cca9cd2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:09.748294 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-2b91bf72-0fdd-4068-b79a-3aaa1cca9cd2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.160899 Jun 07 13:31:09.748877 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 520/1067] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:09 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:10.766060 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-e1ead236-2db6-4ebb-b360-fb5c206b6620 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:10.766680 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-e1ead236-2db6-4ebb-b360-fb5c206b6620 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:10.773275 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e1ead236-2db6-4ebb-b360-fb5c206b6620 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:10.773723 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e1ead236-2db6-4ebb-b360-fb5c206b6620 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:10.775205 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e1ead236-2db6-4ebb-b360-fb5c206b6620 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:10.775656 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-e1ead236-2db6-4ebb-b360-fb5c206b6620 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:10.917146 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-e1ead236-2db6-4ebb-b360-fb5c206b6620 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:10.926363 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-e1ead236-2db6-4ebb-b360-fb5c206b6620 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.163496 Jun 07 13:31:10.926987 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 548/1068] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:10 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:11.945661 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e2bdb598-4b87-4590-843d-d08dc520d3e9 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:11.946265 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e2bdb598-4b87-4590-843d-d08dc520d3e9 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:11.953049 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2bdb598-4b87-4590-843d-d08dc520d3e9 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:11.953502 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2bdb598-4b87-4590-843d-d08dc520d3e9 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:11.954293 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2bdb598-4b87-4590-843d-d08dc520d3e9 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:11.954741 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e2bdb598-4b87-4590-843d-d08dc520d3e9 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:12.107037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e2bdb598-4b87-4590-843d-d08dc520d3e9 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:12.114546 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e2bdb598-4b87-4590-843d-d08dc520d3e9 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.172827 Jun 07 13:31:12.115152 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 521/1069] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:11 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:13.131469 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c11d423e-91ba-4159-83de-ed851e3aa8c1 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:13.132388 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c11d423e-91ba-4159-83de-ed851e3aa8c1 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:13.139006 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c11d423e-91ba-4159-83de-ed851e3aa8c1 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:13.139454 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c11d423e-91ba-4159-83de-ed851e3aa8c1 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:13.140221 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c11d423e-91ba-4159-83de-ed851e3aa8c1 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:13.140653 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c11d423e-91ba-4159-83de-ed851e3aa8c1 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:13.288616 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c11d423e-91ba-4159-83de-ed851e3aa8c1 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:13.300515 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c11d423e-91ba-4159-83de-ed851e3aa8c1 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.172760 Jun 07 13:31:13.301124 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 549/1070] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:13 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:14.318963 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-84cf5b5e-64ed-41e0-b6e1-c17598404c2b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:14.319736 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-84cf5b5e-64ed-41e0-b6e1-c17598404c2b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:14.322576 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell0:SELECT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:31:14.330091 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-84cf5b5e-64ed-41e0-b6e1-c17598404c2b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:14.330745 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-84cf5b5e-64ed-41e0-b6e1-c17598404c2b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:14.331935 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-84cf5b5e-64ed-41e0-b6e1-c17598404c2b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:14.332705 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-84cf5b5e-64ed-41e0-b6e1-c17598404c2b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:14.507743 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-84cf5b5e-64ed-41e0-b6e1-c17598404c2b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:14.517257 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-84cf5b5e-64ed-41e0-b6e1-c17598404c2b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.204102 Jun 07 13:31:14.517863 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 522/1071] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:14 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:15.539031 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-76db7d8a-c972-4d59-8ea8-227abffb6f59 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:15.539993 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-76db7d8a-c972-4d59-8ea8-227abffb6f59 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:15.543000 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=2 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:31:15.544131 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell0:SELECT=6 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:31:15.553057 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-76db7d8a-c972-4d59-8ea8-227abffb6f59 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:15.553506 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-76db7d8a-c972-4d59-8ea8-227abffb6f59 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:15.554287 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-76db7d8a-c972-4d59-8ea8-227abffb6f59 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:15.554724 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-76db7d8a-c972-4d59-8ea8-227abffb6f59 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:15.712297 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-76db7d8a-c972-4d59-8ea8-227abffb6f59 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:15.720056 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-76db7d8a-c972-4d59-8ea8-227abffb6f59 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.188317 Jun 07 13:31:15.720640 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 550/1072] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:15 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:16.742731 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fa262e13-d2a7-4c15-9f2a-6e79f0cc8035 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:16.743749 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fa262e13-d2a7-4c15-9f2a-6e79f0cc8035 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:16.752695 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa262e13-d2a7-4c15-9f2a-6e79f0cc8035 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:16.753496 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa262e13-d2a7-4c15-9f2a-6e79f0cc8035 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:16.755356 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa262e13-d2a7-4c15-9f2a-6e79f0cc8035 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:16.755356 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fa262e13-d2a7-4c15-9f2a-6e79f0cc8035 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:16.944443 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fa262e13-d2a7-4c15-9f2a-6e79f0cc8035 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:16.957992 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fa262e13-d2a7-4c15-9f2a-6e79f0cc8035 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.221829 Jun 07 13:31:16.959015 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 523/1073] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:16 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:31:16.974880 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-32b1f6ed-8a60-42f1-ac64-e2eaa3ab5cc8 req-e9c380a0-31a7-47b9-a536-9fe9080e45bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5a2d6e-60e0-4a54-9900-6b40dd6c365a", "name": "network-vif-plugged", "status": "completed", "tag": "f4e6e8bd-f53b-43db-ad12-957650bf7ac4"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:31:16.987803 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-32b1f6ed-8a60-42f1-ac64-e2eaa3ab5cc8 req-e9c380a0-31a7-47b9-a536-9fe9080e45bf service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:16.988272 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-32b1f6ed-8a60-42f1-ac64-e2eaa3ab5cc8 req-e9c380a0-31a7-47b9-a536-9fe9080e45bf service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:17.001696 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-32b1f6ed-8a60-42f1-ac64-e2eaa3ab5cc8 req-e9c380a0-31a7-47b9-a536-9fe9080e45bf service nova] Creating event network-vif-plugged:f4e6e8bd-f53b-43db-ad12-957650bf7ac4 for instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a on hv-cinder-84460 Jun 07 13:31:17.007514 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-32b1f6ed-8a60-42f1-ac64-e2eaa3ab5cc8 req-e9c380a0-31a7-47b9-a536-9fe9080e45bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126118 Jun 07 13:31:17.009007 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 551/1074] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:31:17.980417 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-5b64cfea-3278-42ba-9424-d5a0ca3e2514 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:17.981032 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-5b64cfea-3278-42ba-9424-d5a0ca3e2514 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:17.987915 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5b64cfea-3278-42ba-9424-d5a0ca3e2514 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:17.988398 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5b64cfea-3278-42ba-9424-d5a0ca3e2514 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:17.989259 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5b64cfea-3278-42ba-9424-d5a0ca3e2514 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:17.989705 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-5b64cfea-3278-42ba-9424-d5a0ca3e2514 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:18.162181 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-5b64cfea-3278-42ba-9424-d5a0ca3e2514 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:18.175165 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-5b64cfea-3278-42ba-9424-d5a0ca3e2514 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1260 microversion: 2.1 time: 0.199036 Jun 07 13:31:18.180344 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 524/1075] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:17 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:19.198171 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-a655a812-af2b-4bdd-bd03-05d4dfb4a4d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:19.198918 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-a655a812-af2b-4bdd-bd03-05d4dfb4a4d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:19.205791 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a655a812-af2b-4bdd-bd03-05d4dfb4a4d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:19.206245 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a655a812-af2b-4bdd-bd03-05d4dfb4a4d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:19.207038 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a655a812-af2b-4bdd-bd03-05d4dfb4a4d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:19.207478 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-a655a812-af2b-4bdd-bd03-05d4dfb4a4d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:19.340130 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-a655a812-af2b-4bdd-bd03-05d4dfb4a4d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:19.348065 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-a655a812-af2b-4bdd-bd03-05d4dfb4a4d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1443 microversion: 2.1 time: 0.154204 Jun 07 13:31:19.348637 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 552/1076] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:19 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:19.364792 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-a44613b0-6583-49b0-b3b2-5c8face8efac tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:31:19.366257 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-a44613b0-6583-49b0-b3b2-5c8face8efac tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:31:19.372285 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a44613b0-6583-49b0-b3b2-5c8face8efac tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:19.372739 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a44613b0-6583-49b0-b3b2-5c8face8efac tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:19.373500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a44613b0-6583-49b0-b3b2-5c8face8efac tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:19.373961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-a44613b0-6583-49b0-b3b2-5c8face8efac tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:19.503979 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-a44613b0-6583-49b0-b3b2-5c8face8efac tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:31:19.512156 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-a44613b0-6583-49b0-b3b2-5c8face8efac tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1443 microversion: 2.1 time: 0.151190 Jun 07 13:31:19.512715 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 525/1077] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:31:19 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:31:21.195118 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-5614d2aa-fc7c-4b39-b03e-7a3280f145c5 req-ca879c4f-0a5c-4cf6-9beb-8edb6cc2a13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5a2d6e-60e0-4a54-9900-6b40dd6c365a", "tag": "f4e6e8bd-f53b-43db-ad12-957650bf7ac4"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:31:21.203419 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-5614d2aa-fc7c-4b39-b03e-7a3280f145c5 req-ca879c4f-0a5c-4cf6-9beb-8edb6cc2a13d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:31:21.203867 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-5614d2aa-fc7c-4b39-b03e-7a3280f145c5 req-ca879c4f-0a5c-4cf6-9beb-8edb6cc2a13d service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:31:21.216471 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-5614d2aa-fc7c-4b39-b03e-7a3280f145c5 req-ca879c4f-0a5c-4cf6-9beb-8edb6cc2a13d service nova] Creating event network-changed:f4e6e8bd-f53b-43db-ad12-957650bf7ac4 for instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a on hv-cinder-84460 Jun 07 13:31:21.223651 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-5614d2aa-fc7c-4b39-b03e-7a3280f145c5 req-ca879c4f-0a5c-4cf6-9beb-8edb6cc2a13d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085367 Jun 07 13:31:21.224685 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 553/1078] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:31:47.001610 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:31:47.002219 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Tue Jun 7 13:31:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:33:11.693239 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:33:11.694251 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Tue Jun 7 13:33:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:33:19.569228 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f41de74-e487-4b0d-858a-94bd08e09b65] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 07 13:33:19.570045 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=20 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:33:19.570794 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=48 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:33:19.575485 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-6895169a-d984-4663-8e5b-e76159e3c44f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:33:19.576037 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-6895169a-d984-4663-8e5b-e76159e3c44f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:19.585428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6895169a-d984-4663-8e5b-e76159e3c44f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:19.585428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6895169a-d984-4663-8e5b-e76159e3c44f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:19.585428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6895169a-d984-4663-8e5b-e76159e3c44f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:19.585428 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-6895169a-d984-4663-8e5b-e76159e3c44f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:19.609441 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.objects.instance [None req-6895169a-d984-4663-8e5b-e76159e3c44f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lazy-loading 'flavor' on Instance uuid fd5a2d6e-60e0-4a54-9900-6b40dd6c365a {{(pid=117842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:33:19.691209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-6895169a-d984-4663-8e5b-e76159e3c44f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "POST /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a/action" status: 202 len: 0 microversion: 2.1 time: 0.123308 Jun 07 13:33:19.691790 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 526/1079] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:33:19 2022] POST /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:33:19.699470 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:33:19.700643 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=44 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:33:19.705365 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-cf7f3fcd-b4d7-499f-a3fc-cc94dca44574 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:19.706077 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-cf7f3fcd-b4d7-499f-a3fc-cc94dca44574 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:19.713858 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cf7f3fcd-b4d7-499f-a3fc-cc94dca44574 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:19.714309 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cf7f3fcd-b4d7-499f-a3fc-cc94dca44574 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:19.715121 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cf7f3fcd-b4d7-499f-a3fc-cc94dca44574 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:19.715720 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-cf7f3fcd-b4d7-499f-a3fc-cc94dca44574 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:19.934004 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-cf7f3fcd-b4d7-499f-a3fc-cc94dca44574 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:19.941957 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-cf7f3fcd-b4d7-499f-a3fc-cc94dca44574 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.245259 Jun 07 13:33:19.942462 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 554/1080] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:19 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:20.963490 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c9f95ef0-1a24-47a6-a8ab-b45025805db4 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:20.964112 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c9f95ef0-1a24-47a6-a8ab-b45025805db4 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:20.974675 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f41de74-e487-4b0d-858a-94bd08e09b65] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 55258. Jun 07 13:33:20.977142 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9f95ef0-1a24-47a6-a8ab-b45025805db4 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:20.977590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9f95ef0-1a24-47a6-a8ab-b45025805db4 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:20.978867 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9f95ef0-1a24-47a6-a8ab-b45025805db4 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:20.979302 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c9f95ef0-1a24-47a6-a8ab-b45025805db4 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:21.163112 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c9f95ef0-1a24-47a6-a8ab-b45025805db4 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:21.171350 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c9f95ef0-1a24-47a6-a8ab-b45025805db4 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.213277 Jun 07 13:33:21.171972 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 527/1081] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:20 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:22.188750 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-55265d96-fc23-41d1-9d9a-53fe7abc3c38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:22.189425 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-55265d96-fc23-41d1-9d9a-53fe7abc3c38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:22.195996 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55265d96-fc23-41d1-9d9a-53fe7abc3c38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:22.196447 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55265d96-fc23-41d1-9d9a-53fe7abc3c38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:22.197303 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55265d96-fc23-41d1-9d9a-53fe7abc3c38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:22.197736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-55265d96-fc23-41d1-9d9a-53fe7abc3c38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:22.329881 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-55265d96-fc23-41d1-9d9a-53fe7abc3c38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:22.338079 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-55265d96-fc23-41d1-9d9a-53fe7abc3c38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.152644 Jun 07 13:33:22.338652 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 555/1082] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:22 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:23.356135 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e66b0897-cfc7-4699-ba1f-18a23a4e6a06 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:23.356859 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e66b0897-cfc7-4699-ba1f-18a23a4e6a06 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:23.363639 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e66b0897-cfc7-4699-ba1f-18a23a4e6a06 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:23.364095 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e66b0897-cfc7-4699-ba1f-18a23a4e6a06 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:23.364872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e66b0897-cfc7-4699-ba1f-18a23a4e6a06 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:23.365306 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e66b0897-cfc7-4699-ba1f-18a23a4e6a06 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:23.516307 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e66b0897-cfc7-4699-ba1f-18a23a4e6a06 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:23.525267 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e66b0897-cfc7-4699-ba1f-18a23a4e6a06 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.173441 Jun 07 13:33:23.525846 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 528/1083] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:23 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:24.542895 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-b29ff93c-93f4-4200-b709-02525432ea33 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:24.543453 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-b29ff93c-93f4-4200-b709-02525432ea33 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:24.549907 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b29ff93c-93f4-4200-b709-02525432ea33 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:24.550364 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b29ff93c-93f4-4200-b709-02525432ea33 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:24.551162 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b29ff93c-93f4-4200-b709-02525432ea33 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:24.551602 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-b29ff93c-93f4-4200-b709-02525432ea33 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:24.682507 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-b29ff93c-93f4-4200-b709-02525432ea33 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:24.690347 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-b29ff93c-93f4-4200-b709-02525432ea33 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.152040 Jun 07 13:33:24.690983 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 556/1084] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:24 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:25.708205 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-fe148796-ddc6-42dc-9ca4-c308cfc31fc8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:25.708762 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-fe148796-ddc6-42dc-9ca4-c308cfc31fc8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:25.715418 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fe148796-ddc6-42dc-9ca4-c308cfc31fc8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:25.715875 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fe148796-ddc6-42dc-9ca4-c308cfc31fc8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:25.716649 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fe148796-ddc6-42dc-9ca4-c308cfc31fc8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:25.717087 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-fe148796-ddc6-42dc-9ca4-c308cfc31fc8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:25.847099 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-fe148796-ddc6-42dc-9ca4-c308cfc31fc8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:25.855403 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-fe148796-ddc6-42dc-9ca4-c308cfc31fc8 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.151174 Jun 07 13:33:25.856000 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 529/1085] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:25 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:26.873030 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ba3283ab-026b-4f90-bed3-60eca49cb66f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:26.873657 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ba3283ab-026b-4f90-bed3-60eca49cb66f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:26.880621 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ba3283ab-026b-4f90-bed3-60eca49cb66f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:26.881072 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ba3283ab-026b-4f90-bed3-60eca49cb66f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:26.881856 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ba3283ab-026b-4f90-bed3-60eca49cb66f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:26.882293 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ba3283ab-026b-4f90-bed3-60eca49cb66f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:27.041900 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ba3283ab-026b-4f90-bed3-60eca49cb66f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:27.050208 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ba3283ab-026b-4f90-bed3-60eca49cb66f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.181148 Jun 07 13:33:27.050891 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 557/1086] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:26 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:28.067907 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-19ae6967-2116-4c15-8b9f-bccaa167105f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:28.068529 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-19ae6967-2116-4c15-8b9f-bccaa167105f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:28.075242 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-19ae6967-2116-4c15-8b9f-bccaa167105f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:28.075696 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-19ae6967-2116-4c15-8b9f-bccaa167105f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:28.076500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-19ae6967-2116-4c15-8b9f-bccaa167105f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:28.076923 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-19ae6967-2116-4c15-8b9f-bccaa167105f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:28.209938 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-19ae6967-2116-4c15-8b9f-bccaa167105f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:28.218300 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-19ae6967-2116-4c15-8b9f-bccaa167105f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.154235 Jun 07 13:33:28.220868 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 530/1087] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:28 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:29.237544 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-c4d6893a-3a59-44d0-90e4-31cbd06c4e3d tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:29.238165 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-c4d6893a-3a59-44d0-90e4-31cbd06c4e3d tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:29.244857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c4d6893a-3a59-44d0-90e4-31cbd06c4e3d tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:29.245315 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c4d6893a-3a59-44d0-90e4-31cbd06c4e3d tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:29.246084 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c4d6893a-3a59-44d0-90e4-31cbd06c4e3d tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:29.246522 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-c4d6893a-3a59-44d0-90e4-31cbd06c4e3d tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:29.394586 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-c4d6893a-3a59-44d0-90e4-31cbd06c4e3d tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:29.403138 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-c4d6893a-3a59-44d0-90e4-31cbd06c4e3d tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.169345 Jun 07 13:33:29.403730 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 558/1088] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:29 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:30.420942 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-dd6a39e1-909a-40ad-8b67-e989f28b0017 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:30.422009 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-dd6a39e1-909a-40ad-8b67-e989f28b0017 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:30.428527 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dd6a39e1-909a-40ad-8b67-e989f28b0017 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:30.428961 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dd6a39e1-909a-40ad-8b67-e989f28b0017 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:30.429732 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dd6a39e1-909a-40ad-8b67-e989f28b0017 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:30.430164 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-dd6a39e1-909a-40ad-8b67-e989f28b0017 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:30.568009 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-dd6a39e1-909a-40ad-8b67-e989f28b0017 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:30.576288 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-dd6a39e1-909a-40ad-8b67-e989f28b0017 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.159320 Jun 07 13:33:30.576885 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 531/1089] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:30 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:31.598348 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-05cf4305-3d1e-4e75-9dcd-15e778240e6b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:31.599592 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-05cf4305-3d1e-4e75-9dcd-15e778240e6b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:31.607284 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-05cf4305-3d1e-4e75-9dcd-15e778240e6b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:31.607736 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-05cf4305-3d1e-4e75-9dcd-15e778240e6b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:31.608517 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-05cf4305-3d1e-4e75-9dcd-15e778240e6b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:31.608958 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-05cf4305-3d1e-4e75-9dcd-15e778240e6b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:31.744578 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-05cf4305-3d1e-4e75-9dcd-15e778240e6b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:31.752190 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-05cf4305-3d1e-4e75-9dcd-15e778240e6b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.161435 Jun 07 13:33:31.752761 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 559/1090] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:31 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:32.769578 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-713d3f6d-f05e-4270-93eb-71b5927130d5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:32.770209 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-713d3f6d-f05e-4270-93eb-71b5927130d5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:32.777140 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-713d3f6d-f05e-4270-93eb-71b5927130d5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:32.777598 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-713d3f6d-f05e-4270-93eb-71b5927130d5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:32.778383 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-713d3f6d-f05e-4270-93eb-71b5927130d5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:32.778846 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-713d3f6d-f05e-4270-93eb-71b5927130d5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:32.916454 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-713d3f6d-f05e-4270-93eb-71b5927130d5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:32.924401 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-713d3f6d-f05e-4270-93eb-71b5927130d5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.158736 Jun 07 13:33:32.924896 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 532/1091] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:32 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:33.941440 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-f1e7f614-57f0-4088-8e72-7da7c6f3c1a2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:33.942061 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-f1e7f614-57f0-4088-8e72-7da7c6f3c1a2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:33.949399 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f1e7f614-57f0-4088-8e72-7da7c6f3c1a2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:33.949857 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f1e7f614-57f0-4088-8e72-7da7c6f3c1a2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:33.950638 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f1e7f614-57f0-4088-8e72-7da7c6f3c1a2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:33.951106 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-f1e7f614-57f0-4088-8e72-7da7c6f3c1a2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:34.094559 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-f1e7f614-57f0-4088-8e72-7da7c6f3c1a2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:34.102590 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-f1e7f614-57f0-4088-8e72-7da7c6f3c1a2 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1509 microversion: 2.1 time: 0.164961 Jun 07 13:33:34.103196 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 560/1092] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:33 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:34.119860 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e3e1b08f-a05d-4d3c-90f9-982b0b5649a5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:33:34.120472 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e3e1b08f-a05d-4d3c-90f9-982b0b5649a5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:34.126990 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3e1b08f-a05d-4d3c-90f9-982b0b5649a5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:34.127438 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3e1b08f-a05d-4d3c-90f9-982b0b5649a5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:34.128203 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3e1b08f-a05d-4d3c-90f9-982b0b5649a5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:34.128635 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e3e1b08f-a05d-4d3c-90f9-982b0b5649a5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:34.270855 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e3e1b08f-a05d-4d3c-90f9-982b0b5649a5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "POST /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a/action" status: 202 len: 0 microversion: 2.1 time: 0.155216 Jun 07 13:33:34.271661 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 533/1093] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Jun 7 13:33:34 2022] POST /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:33:34.279896 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-ed1d1c20-e779-464c-9fb6-859125203aab tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:34.280523 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-ed1d1c20-e779-464c-9fb6-859125203aab tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:34.288765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ed1d1c20-e779-464c-9fb6-859125203aab tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:34.288765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ed1d1c20-e779-464c-9fb6-859125203aab tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:34.288765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ed1d1c20-e779-464c-9fb6-859125203aab tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:34.288765 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-ed1d1c20-e779-464c-9fb6-859125203aab tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:34.446343 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-ed1d1c20-e779-464c-9fb6-859125203aab tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:34.456359 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-ed1d1c20-e779-464c-9fb6-859125203aab tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1517 microversion: 2.1 time: 0.179982 Jun 07 13:33:34.458966 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 561/1094] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:34 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:35.479244 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e326a120-c72e-444e-8072-3b19a6ff7131 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:35.480149 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e326a120-c72e-444e-8072-3b19a6ff7131 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:35.487697 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e326a120-c72e-444e-8072-3b19a6ff7131 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:35.488188 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e326a120-c72e-444e-8072-3b19a6ff7131 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:35.488922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e326a120-c72e-444e-8072-3b19a6ff7131 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:35.489456 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e326a120-c72e-444e-8072-3b19a6ff7131 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:35.639686 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e326a120-c72e-444e-8072-3b19a6ff7131 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:35.656578 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e326a120-c72e-444e-8072-3b19a6ff7131 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1519 microversion: 2.1 time: 0.181265 Jun 07 13:33:35.657569 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 534/1095] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:35 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:35.660800 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-87ca084f-25fd-4b3c-9933-af2284df66ea req-c1c289de-4e08-4c8d-b0cd-7e5ff6381ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5a2d6e-60e0-4a54-9900-6b40dd6c365a", "name": "network-vif-unplugged", "status": "completed", "tag": "f4e6e8bd-f53b-43db-ad12-957650bf7ac4"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:33:35.670594 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-87ca084f-25fd-4b3c-9933-af2284df66ea req-c1c289de-4e08-4c8d-b0cd-7e5ff6381ccc service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:35.671233 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-87ca084f-25fd-4b3c-9933-af2284df66ea req-c1c289de-4e08-4c8d-b0cd-7e5ff6381ccc service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:35.685975 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.compute.server_external_events [req-87ca084f-25fd-4b3c-9933-af2284df66ea req-c1c289de-4e08-4c8d-b0cd-7e5ff6381ccc service nova] Unable to find a host for instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a. Dropping event network-vif-unplugged {{(pid=117843) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 13:33:35.687267 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-87ca084f-25fd-4b3c-9933-af2284df66ea req-c1c289de-4e08-4c8d-b0cd-7e5ff6381ccc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031016 Jun 07 13:33:35.688294 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 562/1096] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 13:33:36.679561 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e73de91e-b887-4db0-b18a-f8cae34fdc93 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:36.680192 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e73de91e-b887-4db0-b18a-f8cae34fdc93 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:36.687123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e73de91e-b887-4db0-b18a-f8cae34fdc93 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:36.687574 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e73de91e-b887-4db0-b18a-f8cae34fdc93 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:36.688349 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e73de91e-b887-4db0-b18a-f8cae34fdc93 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:36.688781 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e73de91e-b887-4db0-b18a-f8cae34fdc93 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:36.832326 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-e73de91e-b887-4db0-b18a-f8cae34fdc93 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:36.844252 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e73de91e-b887-4db0-b18a-f8cae34fdc93 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.168552 Jun 07 13:33:36.844856 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 535/1097] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:36 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:37.866418 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-0e62f884-4814-4876-9827-1db96995d59f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:37.867091 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-0e62f884-4814-4876-9827-1db96995d59f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:37.874183 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0e62f884-4814-4876-9827-1db96995d59f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:37.875503 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0e62f884-4814-4876-9827-1db96995d59f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:37.875503 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0e62f884-4814-4876-9827-1db96995d59f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:37.875897 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-0e62f884-4814-4876-9827-1db96995d59f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:38.009526 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-0e62f884-4814-4876-9827-1db96995d59f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:38.018533 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-0e62f884-4814-4876-9827-1db96995d59f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.154784 Jun 07 13:33:38.018533 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 563/1098] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:37 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:39.033510 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-f6aac9f8-5fb3-48c1-91f8-8a174d67a8d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:39.034119 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-f6aac9f8-5fb3-48c1-91f8-8a174d67a8d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:39.040879 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f6aac9f8-5fb3-48c1-91f8-8a174d67a8d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:39.041324 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f6aac9f8-5fb3-48c1-91f8-8a174d67a8d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:39.042898 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f6aac9f8-5fb3-48c1-91f8-8a174d67a8d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:39.042898 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-f6aac9f8-5fb3-48c1-91f8-8a174d67a8d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:39.177424 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-f6aac9f8-5fb3-48c1-91f8-8a174d67a8d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:39.185872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-f6aac9f8-5fb3-48c1-91f8-8a174d67a8d6 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.156186 Jun 07 13:33:39.186447 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 536/1099] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:39 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:40.203120 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-eb2fa3a9-7f22-41f3-a65b-2f3498a5a492 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:40.203932 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-eb2fa3a9-7f22-41f3-a65b-2f3498a5a492 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:40.210467 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eb2fa3a9-7f22-41f3-a65b-2f3498a5a492 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:40.210969 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eb2fa3a9-7f22-41f3-a65b-2f3498a5a492 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:40.212244 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eb2fa3a9-7f22-41f3-a65b-2f3498a5a492 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:40.212687 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-eb2fa3a9-7f22-41f3-a65b-2f3498a5a492 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:40.353577 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-eb2fa3a9-7f22-41f3-a65b-2f3498a5a492 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:40.361869 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-eb2fa3a9-7f22-41f3-a65b-2f3498a5a492 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.162642 Jun 07 13:33:40.362459 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 564/1100] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:40 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:41.380969 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0707ab60-668e-40a3-9090-c1c2c37baebb tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:41.381617 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0707ab60-668e-40a3-9090-c1c2c37baebb tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:41.388809 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0707ab60-668e-40a3-9090-c1c2c37baebb tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:41.389271 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0707ab60-668e-40a3-9090-c1c2c37baebb tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:41.390086 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0707ab60-668e-40a3-9090-c1c2c37baebb tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:41.390507 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0707ab60-668e-40a3-9090-c1c2c37baebb tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:41.539234 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0707ab60-668e-40a3-9090-c1c2c37baebb tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:41.548280 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0707ab60-668e-40a3-9090-c1c2c37baebb tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.172837 Jun 07 13:33:41.548932 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 537/1101] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:41 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:42.565843 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-3ea62410-e8b0-4e4e-8a6f-eb9298c46ee5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:42.566616 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-3ea62410-e8b0-4e4e-8a6f-eb9298c46ee5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:42.576009 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3ea62410-e8b0-4e4e-8a6f-eb9298c46ee5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:42.576487 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3ea62410-e8b0-4e4e-8a6f-eb9298c46ee5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:42.577330 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3ea62410-e8b0-4e4e-8a6f-eb9298c46ee5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:42.577811 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-3ea62410-e8b0-4e4e-8a6f-eb9298c46ee5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:42.718374 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-3ea62410-e8b0-4e4e-8a6f-eb9298c46ee5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:42.726710 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-3ea62410-e8b0-4e4e-8a6f-eb9298c46ee5 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.164615 Jun 07 13:33:42.727837 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 565/1102] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:42 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:43.745524 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-0a2c3d74-f58e-4c1a-8dd3-400a1b68f092 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:43.746362 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-0a2c3d74-f58e-4c1a-8dd3-400a1b68f092 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:43.754401 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0a2c3d74-f58e-4c1a-8dd3-400a1b68f092 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:43.754882 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0a2c3d74-f58e-4c1a-8dd3-400a1b68f092 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:43.756981 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0a2c3d74-f58e-4c1a-8dd3-400a1b68f092 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:43.757500 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-0a2c3d74-f58e-4c1a-8dd3-400a1b68f092 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:43.901954 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-0a2c3d74-f58e-4c1a-8dd3-400a1b68f092 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:43.910377 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-0a2c3d74-f58e-4c1a-8dd3-400a1b68f092 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.169469 Jun 07 13:33:43.911081 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 538/1103] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:43 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:44.927740 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-da5f7b73-5c24-4382-ae01-e70775650f3b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:44.928390 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-da5f7b73-5c24-4382-ae01-e70775650f3b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:44.935150 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-da5f7b73-5c24-4382-ae01-e70775650f3b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:44.935599 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-da5f7b73-5c24-4382-ae01-e70775650f3b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:44.936367 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-da5f7b73-5c24-4382-ae01-e70775650f3b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:44.936800 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-da5f7b73-5c24-4382-ae01-e70775650f3b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:45.078804 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-da5f7b73-5c24-4382-ae01-e70775650f3b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:45.087383 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-da5f7b73-5c24-4382-ae01-e70775650f3b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.163483 Jun 07 13:33:45.087999 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 566/1104] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:44 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:33:45.740811 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-c7412c7e-57fe-4848-b03a-417eadbbe7c3 req-76d9fe42-1c67-43de-8e49-80a2866053a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5a2d6e-60e0-4a54-9900-6b40dd6c365a", "name": "network-vif-plugged", "status": "completed", "tag": "f4e6e8bd-f53b-43db-ad12-957650bf7ac4"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:33:45.752158 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-c7412c7e-57fe-4848-b03a-417eadbbe7c3 req-76d9fe42-1c67-43de-8e49-80a2866053a2 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:45.752623 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-c7412c7e-57fe-4848-b03a-417eadbbe7c3 req-76d9fe42-1c67-43de-8e49-80a2866053a2 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:45.765169 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-c7412c7e-57fe-4848-b03a-417eadbbe7c3 req-76d9fe42-1c67-43de-8e49-80a2866053a2 service nova] Creating event network-vif-plugged:f4e6e8bd-f53b-43db-ad12-957650bf7ac4 for instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a on hv-cinder-84460 Jun 07 13:33:45.770349 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-c7412c7e-57fe-4848-b03a-417eadbbe7c3 req-76d9fe42-1c67-43de-8e49-80a2866053a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033512 Jun 07 13:33:45.770989 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 539/1105] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:33:46.105588 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-618e69f1-48e2-4247-bb98-465088d1b230 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:46.106198 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-618e69f1-48e2-4247-bb98-465088d1b230 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:46.112971 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-618e69f1-48e2-4247-bb98-465088d1b230 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:46.113693 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-618e69f1-48e2-4247-bb98-465088d1b230 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:46.114641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-618e69f1-48e2-4247-bb98-465088d1b230 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:46.115265 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-618e69f1-48e2-4247-bb98-465088d1b230 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:46.254423 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-618e69f1-48e2-4247-bb98-465088d1b230 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:46.262709 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-618e69f1-48e2-4247-bb98-465088d1b230 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.161833 Jun 07 13:33:46.263251 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 567/1106] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:46 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:47.280834 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-7c11dd41-ba4f-485d-8e2c-0db76105310b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:47.281538 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-7c11dd41-ba4f-485d-8e2c-0db76105310b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:47.287952 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7c11dd41-ba4f-485d-8e2c-0db76105310b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:47.288405 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7c11dd41-ba4f-485d-8e2c-0db76105310b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:47.289685 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7c11dd41-ba4f-485d-8e2c-0db76105310b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:47.290123 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-7c11dd41-ba4f-485d-8e2c-0db76105310b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:47.294420 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:33:47.432357 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-7c11dd41-ba4f-485d-8e2c-0db76105310b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:47.444802 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-7c11dd41-ba4f-485d-8e2c-0db76105310b tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1575 microversion: 2.1 time: 0.168571 Jun 07 13:33:47.445403 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 540/1107] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:47 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:33:48.467781 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2c672542-4891-4d36-9509-99490edc3f3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:33:48.468429 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2c672542-4891-4d36-9509-99490edc3f3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:33:48.475165 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2c672542-4891-4d36-9509-99490edc3f3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:48.475619 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2c672542-4891-4d36-9509-99490edc3f3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:48.476649 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2c672542-4891-4d36-9509-99490edc3f3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:33:48.477641 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2c672542-4891-4d36-9509-99490edc3f3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:33:48.621188 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2c672542-4891-4d36-9509-99490edc3f3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:33:48.629422 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2c672542-4891-4d36-9509-99490edc3f3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1562 microversion: 2.1 time: 0.165814 Jun 07 13:33:48.630036 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 568/1108] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:33:48 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:34:49.896964 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:34:49.897719 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Tue Jun 7 13:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:35:08.322475 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_api:SELECT=32 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:35:08.323640 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG dbcounter [-] [117842] Writing DB stats nova_cell1:SELECT=4 {{(pid=117842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:35:08.325429 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_api:SELECT=30 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:35:08.326277 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG dbcounter [-] [117843] Writing DB stats nova_cell1:SELECT=86 {{(pid=117843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:35:08.327554 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-e7583c0e-505c-4eaa-b9d8-883858463639 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:35:08.328052 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e7583c0e-505c-4eaa-b9d8-883858463639 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:35:08.336587 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e7583c0e-505c-4eaa-b9d8-883858463639 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:08.337041 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e7583c0e-505c-4eaa-b9d8-883858463639 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:08.337810 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e7583c0e-505c-4eaa-b9d8-883858463639 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:08.338625 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-e7583c0e-505c-4eaa-b9d8-883858463639 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:08.371775 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-e7583c0e-505c-4eaa-b9d8-883858463639 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Going to try to terminate instance {{(pid=117842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:35:08.391251 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [req-7bb72800-3ac9-4d6d-80bd-d66a0655389d req-c7567890-aed3-45a1-80d8-351078a8258b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5a2d6e-60e0-4a54-9900-6b40dd6c365a", "tag": "f4e6e8bd-f53b-43db-ad12-957650bf7ac4"}]} {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:35:08.400981 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-7bb72800-3ac9-4d6d-80bd-d66a0655389d req-c7567890-aed3-45a1-80d8-351078a8258b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:08.401535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [req-7bb72800-3ac9-4d6d-80bd-d66a0655389d req-c7567890-aed3-45a1-80d8-351078a8258b service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:08.413264 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.compute.server_external_events [req-7bb72800-3ac9-4d6d-80bd-d66a0655389d req-c7567890-aed3-45a1-80d8-351078a8258b service nova] Creating event network-changed:f4e6e8bd-f53b-43db-ad12-957650bf7ac4 for instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a on hv-cinder-84460 Jun 07 13:35:08.424260 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [req-7bb72800-3ac9-4d6d-80bd-d66a0655389d req-c7567890-aed3-45a1-80d8-351078a8258b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100769 Jun 07 13:35:08.425535 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 569/1109] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:35:08.470554 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-e7583c0e-505c-4eaa-b9d8-883858463639 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 204 len: 0 microversion: 2.1 time: 0.149655 Jun 07 13:35:08.471922 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 541/1110] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Jun 7 13:35:08 2022] DELETE /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:35:08.481678 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2126aa69-7816-49cf-8ff2-cb83d2484c3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:35:08.482402 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2126aa69-7816-49cf-8ff2-cb83d2484c3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:35:08.489685 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2126aa69-7816-49cf-8ff2-cb83d2484c3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:08.490664 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2126aa69-7816-49cf-8ff2-cb83d2484c3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:08.491529 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2126aa69-7816-49cf-8ff2-cb83d2484c3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:08.491976 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2126aa69-7816-49cf-8ff2-cb83d2484c3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:08.628923 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2126aa69-7816-49cf-8ff2-cb83d2484c3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:35:08.639242 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2126aa69-7816-49cf-8ff2-cb83d2484c3f tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.162438 Jun 07 13:35:08.639946 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 570/1111] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:35:08 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:35:09.659058 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-c33eea96-8ba5-4113-8265-3ae3f2b00b5a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:35:09.659793 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.compute.api [None req-c33eea96-8ba5-4113-8265-3ae3f2b00b5a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117842) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:35:09.665988 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c33eea96-8ba5-4113-8265-3ae3f2b00b5a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:09.666442 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c33eea96-8ba5-4113-8265-3ae3f2b00b5a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:09.667243 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c33eea96-8ba5-4113-8265-3ae3f2b00b5a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:09.667685 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [None req-c33eea96-8ba5-4113-8265-3ae3f2b00b5a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:09.809839 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.policy [None req-c33eea96-8ba5-4113-8265-3ae3f2b00b5a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117842) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:35:09.819872 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-c33eea96-8ba5-4113-8265-3ae3f2b00b5a tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1568 microversion: 2.1 time: 0.166083 Jun 07 13:35:09.822884 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 542/1112] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:35:09 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:35:10.837398 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-2a57be47-927c-4051-98f4-1a5b7b64bc38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:35:10.837935 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-2a57be47-927c-4051-98f4-1a5b7b64bc38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:35:10.844663 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2a57be47-927c-4051-98f4-1a5b7b64bc38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:10.845155 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2a57be47-927c-4051-98f4-1a5b7b64bc38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:10.845942 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2a57be47-927c-4051-98f4-1a5b7b64bc38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:10.846384 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-2a57be47-927c-4051-98f4-1a5b7b64bc38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:10.917185 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.policy [None req-2a57be47-927c-4051-98f4-1a5b7b64bc38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b564431e6e4f03ba125f749218777a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347761872914cbbb350a639eece5f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117843) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:35:10.925817 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-2a57be47-927c-4051-98f4-1a5b7b64bc38 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 200 len: 1382 microversion: 2.1 time: 0.093025 Jun 07 13:35:10.926570 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 571/1113] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:35:10 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 1382 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:35:10.927150 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [req-40e38905-f5ea-4886-852e-745ecf7022e2 req-d1a659a9-9adb-40fb-af25-d4cd8d1c9f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5a2d6e-60e0-4a54-9900-6b40dd6c365a", "name": "network-vif-deleted", "tag": "f4e6e8bd-f53b-43db-ad12-957650bf7ac4"}]} {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:35:10.936819 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-40e38905-f5ea-4886-852e-745ecf7022e2 req-d1a659a9-9adb-40fb-af25-d4cd8d1c9f54 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:10.937370 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG oslo_concurrency.lockutils [req-40e38905-f5ea-4886-852e-745ecf7022e2 req-d1a659a9-9adb-40fb-af25-d4cd8d1c9f54 service nova] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:10.949329 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.compute.server_external_events [req-40e38905-f5ea-4886-852e-745ecf7022e2 req-d1a659a9-9adb-40fb-af25-d4cd8d1c9f54 service nova] Creating event network-vif-deleted:f4e6e8bd-f53b-43db-ad12-957650bf7ac4 for instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a on hv-cinder-84460 Jun 07 13:35:10.954590 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [req-40e38905-f5ea-4886-852e-745ecf7022e2 req-d1a659a9-9adb-40fb-af25-d4cd8d1c9f54 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031213 Jun 07 13:35:10.955320 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 543/1114] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Jun 7 13:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:35:11.943644 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '>' {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:35:11.944217 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.compute.api [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [instance: fd5a2d6e-60e0-4a54-9900-6b40dd6c365a] Fetching instance by UUID {{(pid=117843) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:35:11.950982 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:11.951440 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:11.952223 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:35:11.952665 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG oslo_concurrency.lockutils [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Lock "a9ba19a5-d43f-4c5f-85dd-5a184b1d25c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:35:11.965921 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.wsgi [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] HTTP exception thrown: Instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a could not be found. Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Request method failure captured: Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: request: GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a HTTP/1.1 Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept: application/json Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Accept-Encoding: identity Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Connection: close Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Length: 0 Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Content-Type: application/json Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Host: 10.222.0.61 Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Openstack-System-Scope: None Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: User-Agent: python-urllib3/1.26.9 Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Auth-Token: gAAAAABin1L9o3crT1ctKLdlU3ckc5BH7vXDjuya4ilLuqOJbKk5vk5jUv4x4GIl_g6tT3UJ4Ll_j4l9S9THoCIVWe-l-6L7drdbkqLjkb1FyF4NHmKuSJcsGSOfhhWF_xWud0EN4-115SetGUWPa-cZvFoXCmHSS-Q-FyEna6ovChpjvgkJBQo Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Id: None Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Domain-Name: None Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Identity-Status: Confirmed Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Is-Admin-Project: True Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Id: default Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Domain-Name: Default Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Id: 3347761872914cbbb350a639eece5f9f Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Project-Name: tempest-TestShelveInstance-250651551 Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Role: member,reader Jun 07 13:35:11.967622 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Roles: member,reader Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3347761872914cbbb350a639eece5f9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3347761872914cbbb350a639eece5f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3347761872914cbbb350a639eece5f9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3347761872914cbbb350a639eece5f9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}] Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant: tempest-TestShelveInstance-250651551 Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Id: 3347761872914cbbb350a639eece5f9f Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-Tenant-Name: tempest-TestShelveInstance-250651551 Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User: tempest-TestShelveInstance-250651551-project Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Id: default Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Domain-Name: Default Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Id: a4b564431e6e4f03ba125f749218777a Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: X-User-Name: tempest-TestShelveInstance-250651551-project Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: method: > Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: exception: Instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a could not be found. Jun 07 13:35:11.969406 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: action_args: {'id': 'fd5a2d6e-60e0-4a54-9900-6b40dd6c365a'} Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: {{(pid=117843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a could not be found. Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:35:11.970563 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a could not be found. Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a could not be found. Jun 07 13:35:11.972407 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: ERROR nova.api.openstack.wsgi Jun 07 13:35:11.973885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: DEBUG nova.api.openstack.wsgi [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Returning 404 to user: Instance fd5a2d6e-60e0-4a54-9900-6b40dd6c365a could not be found. {{(pid=117843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:35:11.973885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO nova.api.openstack.requestlog [None req-beee89f2-1e3e-4a8a-bed0-9332b6c175c7 tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a" status: 404 len: 111 microversion: 2.1 time: 0.029346 Jun 07 13:35:11.973885 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: [pid: 117843|app: 0|req: 572/1115] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Jun 7 13:35:11 2022] GET /compute/v2.1/servers/fd5a2d6e-60e0-4a54-9900-6b40dd6c365a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:35:12.132965 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: DEBUG nova.api.openstack.wsgi [None req-81dbd72c-8a4a-4989-b7bd-17ae1a60409e tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] Calling method '.version_select at 0x7f46a943adc0>' {{(pid=117842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:35:12.136144 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: ERROR oslo.messaging._drivers.impl_rabbit [None req-81dbd72c-8a4a-4989-b7bd-17ae1a60409e tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [a45154e6-bffb-4976-98f9-ea7f2196b8a2] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 13:35:13.145084 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO oslo.messaging._drivers.impl_rabbit [None req-81dbd72c-8a4a-4989-b7bd-17ae1a60409e tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] [a45154e6-bffb-4976-98f9-ea7f2196b8a2] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 55396. Jun 07 13:35:13.164555 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO nova.api.openstack.requestlog [None req-81dbd72c-8a4a-4989-b7bd-17ae1a60409e tempest-TestShelveInstance-250651551 tempest-TestShelveInstance-250651551-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1481006062" status: 202 len: 0 microversion: 2.1 time: 1.036422 Jun 07 13:35:13.165136 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: [pid: 117842|app: 0|req: 544/1116] 10.222.0.61 () {58 vars in 1253 bytes} [Tue Jun 7 13:35:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1481006062 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:36:23.155344 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:36:23.156018 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Tue Jun 7 13:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:36:31.706760 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:36:31.707483 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Tue Jun 7 13:36:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:38:09.906287 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:38:09.907018 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Tue Jun 7 13:38:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:38:20.486804 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:38:20.487503 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Tue Jun 7 13:38:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:38:27.013585 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:38:27.014256 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Tue Jun 7 13:38:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:39:43.164279 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:39:43.164935 dv-cinder-844601-3-iscsi devstack@n-api.service[117843]: Tue Jun 7 13:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:39:51.715211 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:39:51.715781 dv-cinder-844601-3-iscsi devstack@n-api.service[117842]: Tue Jun 7 13:39:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!